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OPaonstration Projects Act 
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' • . • . TbiP. folaM. is bnpvof the prod^ of the knowledge 

deVeiopBCTt -effort; d apleai^ted' Of the Tooth 
Bipioifilent and DeaPhstratibi P Act pf 1977i The report f peases 

on thP yoahg school •drpp^bat pbrtion only bf the supported iibrk 
etpetiaenti which: also included 6 ez<-addict8^ and weiDfiare 

irPbipt^tP. The goal of is^ported mrk Is tb/a 

with, well-^establi^hed Eaployaent (aifficaliies io pbtain 4ad keep a 
cegalar iob; in adaitibn# it alas t^^ welfare depend^nciei drag 

user and criaiial actiVityi Between April, 197^ and auiy 197,7 j .fife of 
the deibnsttation si'te8r<^ Atlanta, Hartford, Jersey City # Vew Ibrk, 
and PhiiadliVhiir^-participatP^^^^^ the laippprted work efaloatipn 
saaple. ^Thp^^ aneaployed /1/7- tP 2p-year^pld high schopl 

drbpeatir-^£^ subset of the/^nrbll.e«ui 

eaplbyMnt Bi^^^ a^^^^ up to 12 or; IB nonthsi and 

assirtance" in; :fitding other eBplpyaaif-as their prbgraBveiigibility 
ended. Data ra«f gatherPd for 18 abhihs for 861 youths^ altho.agh only 
i53cybuth& who bAMlie^^^^ priPr to April 1976 cpiiplete4 

an. inter view longei^terB iapactiB Pf suppprte^ ' 

work lare uncertain. The g[«&eral-.cbncla froa this stody- are that 

^he awaiiability; pf K -;8appb^^ work ;j6b^ had shorter na iipacts on. 
eaplbyiient-aiid, cbhsogaPntiyr^bn deppndence on. .public assistance^ but 

. that • tke lprogft dbpfs iibt' appear tprhife iitigated' the Ibngc^ran 
eapipyieht probleas; of these .yM Furtherapre^ thP project had no 
iipact Vbnv ypaji^h.8 ^ in criae. 

Theiirbf ore, sappbrted to does^ hot 'appear to be weli-suitei to 

rtaaelipxatihg:: thi^ e^^ probleas of young dropouts; and the liet . 

,i<»stAbf/.€he' prbgrM 
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idVERViEW^ 



worjC' experi^^^ in the ^puW^^^^ sectors offers a . 



. flrsjk,, tfeer e Is d lregt outpUt from the labor df pa irtici pants the. 
extenf^ft athei^skilt and ability of parti cipafits^ ^th 

emphasis' on -putp^ vjorksi^el Tea^ decree: rf sup^ and 

^ dijscfpltn^^^^^ equfprfent^ ^hif^types;^^^^^^ wdrkv 

iwhichla^^^^ ^ - . • " , 



Secorid, Mere^^^^v^^^^ Is fenjeted oh: youth from T|oWrincpme '^'^^'^'^ 

fami1{l!^ who yi6ul& dthimri ithere jis -an incip^ transfer . ' <l 

neffM:jt Employment . ' > J^l 

problOT^^ and low f auSlly ^^^^ the; matclr is not 

ekact^^ The stricter thev iincome^^ tai^etltig^^ likely that . -aM 

pantitl^^ on tf^^^^ :^^^| 
i^ilscJ tbat*^^^ serious^^^ ne^ts .Will excTudedV the more ;v 

Ajdi^l^^^^ag^^ 

^wprlp^^ 1 jr : 14 

trinsfer ^conte-ihM^^ in fhe: W^ge^^^^^a^^^^^ the jiiorejl i kely that; ;the parU^ iji 
woul d ;haye been pth^rWi s6 iinempl byed f ncreasi ng^^ the net ot^ impact . 

lTic6iTO^ Iransf^^ arfe p^^^^^^ preferabli^^^ cash 

jiaym^^^^ ^EquaTizaU ^employrne^^^^^^^ is a ^^^^^^ 

parti w^^^ :where:^iscr^^ structural factp}^ 

oi" :the i*n^^^^ . ^ 



^ Third f there ar^^^ inrprqgram benefits •resuU 

expjE^rillnc^^^^ One ^hepry-^i^ jpbs> ienye as "ag^^^ in \vA\icn 

noMkV M^ odcuns urider fayprable cpndi tib^^ i .el > Wprk ^keeps ypuXh 

constructive^ ahd helps th^^ the dislpcat^ \^ich might 

irnpede' sub^equ^ent prpirisfsl inr Itfie 'tabor fbfce* Jobs miy ietcH^^ the\ 
wprl^H^^^^^^ and, jtV^ result that ^patticipa^^^ gain in , 

^bb ;hptding; and job :see^^^^ skitls;. ^ the wrkplac^ xa^ be struct^^^ aii 
ihvirpn^^ where bejiHi^r mbdif i^^^^^ ^which^wpuld:^^^ in 

incrMjf^ ?^1^^ the. 4ike* —^Wp^k^^^ ^ 

"l)H)^tall cannje a: sottijrig^^^ disadvantaged"^>^^^^ 
riprmaljy ^^e^^^ b^atkgrouy characteristic^^ can 

prove/ thef are\ dep^enda^^^^ arid^ jp^^^^ rand? cafr atquir^ a resume and ^/ 

credentfal;s> the wbnk :prbjscf may^ .ot training^ in which: ^case- * - 

sp€!Ciific skfl^ acquisition^i,^^^^^ The- work experience #y^^^^^ 

linked t^^^^ br puts^^^^^ thus: us^d as an inducement for 

par^;jicipa^^^^^ ind cpmpletiph .of other activities*' Finally, the job may 

"^g^itffcturea^^ n-an-ideh tif i edi career^l adden>_p rovi d i ng 

accesl Which* w^^^^ ^ * - 
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' iFpurth», work i^experlerice^ have a- range of posft-tprogra^^^ 

^Whfere is :tied tp/,|^mah^ Isntif^ tracks into tareer e^^^ 

>tpy*nehti: access* *tb higher vlii^se:^ .mbfe. sta^ or upwardly mobile jobs ;woutd 
be the ou^tcbme. If ihe-w 

Wprtld-^pt^wprk exppsuH,;. ^j^^^ would presumably cbmpete 

morn effectiV^^^ ^the ;iabbr ma and' there woufd^ impact oh labor 

^fbroe: par^^ and p^ some reduction 1n 



•■'i 



undesirable s^ciaj behavifon. lii training arid ediicatibq are the focus, 
ybdth .might be iore incldried; to return. :to or complete schbbl and advanced 
training^ ' if? the jobs -lare. merely agings vats,, .little xhange- would occur for 
mii participahts! although .a^ :fewf Te« .would enter adulthood; with criminal 
.recordsV'orUilliBgiiimate^ children to thfe -fe^tent theses to job- 

-Ipssness.-- . •-•j.-"' ~ ' 

There- is infinite va.rviatipri- •!> thi- posstble-' clients, of work e^-. 



rperiienee— pifHjgrams= jindr henc e— tii-^ he^teritiil^benefH Ttiere are - 
tffdedffs. For instance,, the ■most pirbdyctive work-^ettihgs are those 
employing: youth- who haVe: thie: fewest- probliMs and who^wilT m^ the. best 
workers. In such^ settingsv it: is also' easiest to sWcture linkages and 
plac^nent into pennaneaf career jobs. VbimUed OTphasis wi be placed on 
basic' skills trainings or fbehaw or nwdHifcat'ibn? so thece will be feW 
expected- in-progriam changes; " X'ikewise, the .income transfer and. emp.loyme^^^ 
equaifzation impacts wiM= be. iTimited to the extent participants hmligfi_ 
probabil i ties pf ^f iiidi ng' work= on their own . The^e- i s al so 1 ess impart ^tp 
the^xteht .resdurces^ i^^^^ supervision or for nonrlabpr inputs wnich 

miike. the wPrk Iftore productive . At th e other extigime» the jobs^ might place 
lii ii i.ied. e j iipt i dbis uii ou.lpul d i td "Tnactr.^mpre- on Jeajniog., they^-wpum ,De 



" targeted to 'youth with ^severe pfobTenis arid woiild have a.higf' transfer . 
. effect. The in-program; .changes, might be extensive but the \ ^asucable . 
.ppst^-prpgram outcomes si ig^^^^ lerst<in the hear :term.^ I""' 

Clearly, then^ youth work experience is. not a-4taridardized activity.— - 
g The •appropriate design depends on .a number of-variab1es such as whether the 

WPfk is^ summer 'bnly, in^s'thbol , or year-r^urid for' out-of-schPoV youths, 
whrther it is directed to t^feri^ers or young adults, and the, level of needs 
of' -participants. - Unfortu/iately, there has been very little progress in 
deterniihing the tradeoffs between the various goals or the most- appropriate 
designs fpr different tirc^^ . 

The suppprted Work • demonstration represents the most* rigorous ex- 
periment to date with the Work, experience appbac^^ In 15 sites around the 
country, wor^ expe.rieric^ pro jiects were impleirierited arid carefully studied. 
Person's enrolled in supportiecl' work were assigned' tp crews comprised pf 
nndividuals likfe themselves, usually lO or less, with a supervisor to sierve 
as - a foreman and cburiiielbri Graduated responsiblfty and stress . was- 
— —employed -in work tasks,-ialong- with^peer fgrp.up interattioh to help youth 
cope with problems and adjustments. The OTployment opportunities lasted up . 
"to &ne year in iiiost cage's. The work. Virjed from construction to light 
manufactyring, spanning iliPst of the t^ks usually addressed by public and 
nonprofit sector work experience. Revenues from the sale of goods, and 
services produced by the work cr'ews .were used to offset the costs. There 
waV a -heavy .eiffphasis: on manajgenient under these projects and careful 
research~pf~the-imp'acts-.----- 

There were four target groups among the 10,000 partifcipants ip 
supported work: welfare recipients, ex-addicts, exrpffenders and youth. 
The'youth group was Tiiaited tb dr^op-buts'age 17 through 20, with 1 of every 
2 required to Jiave a recPrd of delinquency o.r crime. There was no Income 
' targeting -bm the nature of the. sanie effect. Thus, 
supported Work sites are repfeseifitative of better run projects for out- 
of-school^ youth,, perhaps most like the , Youth Community Conservation and^ 
^Improvement Projects instituted under YEDPA. The impacts of supported work 

r ERlC ' " ' . ^ .ii ^ 



were carefulj^ and it. is therefpre suggestive p£ the' ^ffec- 

0 :is> i#6rta^^ to :s tress, spme o^^^ thfe *f ferences betweeh^ 
-suppor-tpa^-W^^^^ and-pther-^outn^i^^ «-Supp6rted work 
' ?erves^ a\^s^^^ cti ent group- 
$h*nT Yjq:it^^ as Tieasured by 
arrests and; edufcatioh but less ^6 when :ffi6a^^^^ receipt of cash as- 
sistance^ . - ' \ . . * . 
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--L^ .With - jts . an|?has,is , 0^^^ supervi-sion ■ and careful manageiifenti 

siipported work: spends relatively less op participant wages arid sal ariec. 
Ihcbire; support amounted to only 47 percent of fiill costs, cbrtipared to 78 
percent ufider YCCIP in fiscal 1979, and 84 penceht under SYEP in ffscal. 
1978. . r . 

^/ Fia^lly, supported work is a stable prograiji. ' Under YCCIPy there is 
enprmpus turnover p^^^ to^^ear, dnd the program itseVf 

phly cbeg^ in iiscia} 197^/ iP cpht^^^^ supported work, has>pi)erSate^ since 
1975 4 some site^^^ the eyattiation is based on costs, which exclude 
startVup expenses^ . ^ufippr^^ wprk is certainly more stable than SYEP which 
isvimplemented anew each. 

keeping in mind these differences, supported work is suggestive of the 
impacts of at least 6be fori/ of work experience for a youth target group 
very much . needing help/ 

The impacts of supported work for youth can be summarized as follows: 

0 Output - It is estimated that thB most likely alternative 
supplier could have prqvicfed the same output as the .Supported work 
projects for a prtcA-egual to .60 percent of the wages and fringes plus 
direct, "project* costs, or 45 jperc^nt of total supported work costs.. 



p Income fnahsfer - Yputh participants received — an — ayerage~of- 
$6,304 per^ yean, in: :wages and Subtracting the 

estimated; vajlue of 'output per* Work hour net of project costs (i.e., 
the^ value :added- by Vouth labpr^^^^ roughly two fifths or $2,500 was 
incprne tran|fen>i /Pnis riepifTesented roughly a fifth of the total 
program cpstiw ? irj l, J,.^. ^ ^^.^^ J « — .^^.^.^ ^ 
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b; Bnploynjent Impact >-" Wagel were. Mi qH^^ above .the minimum and the 
partki panti w^re those, who 'Woiifd be otherwise jobless, i ^ e. , on-ly \ 
■imiV oVer' i third- bf; the wdrked in the first six 
mbnths -afte^^^paM^^^^ In other words, the empldyifient 

impadt coiilii not: bVincreised-i^^^ targeting on lower wages* 

Inct^aangpr^he^hafe 

'CjSuI'dV' hbWever^i :have> incfeas&dMthe^^ Almost all program- 
hdtiM- -were, ^peht in work; h:6urs cduld rhave? been^ s horten ed' and 
su|iplem'ented-t^-unst1pende^^^^ * 

0 ' "ih-Program Benefits^ the mo>t. obv;i.d^us__in-.|irpgr.am benefit is 
increased' inc^fe-.c^iiClimrng' ithe^ <f.1'rst; 9 mdathst after Vienrtoilinent, the , 
averageiiearning's of eVperiii^^ :$338; per month -compa red to $126^ 

. per Bhth for cdntrdlC"^^^^^ 

indirect ihcome transfer-^ but other soiirces df direct, i.ncdme trahsfer . 
wer^ alsd avMlati^le for iparticipatit ^ nd widely-used by. cdntrdl s> The 

--eyl-i i iidl e(l-- V^ fr u ii T vd r luus soOTitgr mithe a months j^s tor 
partidipahts%COT^^ to $"i76i for controls. During tfiis 9 month, 
peridd,. the percentage of ydiiths with any arrests., was s21gMJ^H!i9MrL_ 
#r-:expeMmental>. tha vs. 16.8, after adjusting, for 

differences.- The per^c'ent with robbery cy-rests was slightly less - 3;1 * 
vs, -3.4. The ^perderit ihcarp6rated was less, 8.9 vs. 11;6 and so were.. 
■the >weeks of incarcer?ition, 1.04 vs. ,1.62. In other words, th^re were 

-some slight reduct^ions • iri criminal activity or- at least in^ in-, 
carceratidn- for such 'activity.. The percent reporting drug abiTse other - 
than marijuana or alcdhdl was Tower -11.3 vs. ,U.2 ;p,ercent But the 
perdent using marijiiaha -and alcohol was higher, 56.9 vs. 52.9 percent 
for any use of mafijaaria and 8.1 vs. 5.5 percent. for daily use of 
alcohol.' The impacts dn development of world-of-work skills were not 
directly. iiieasur-edV fidWever, 53", percent of participants left as a 
result of firing,, incarceration, or resignation • because of dis- 
satisfactidh witrthe j^ could not suggest gains unless these 

•accrue from such- negative d _ 

0= Post-Program Impacts, - .Suppdrted wdrk does not, apparently havev 
signiiiicant. transitional; effects. Only 26. p^rdent of youth trainees 
leivt fdr a, jdb. iW tHe>;i9, through 36 months after entry, when, only a 
minuscule portion of partiqipants remained in supported work, the 

/average earnings> per month of participants was $282. conpared to $291 
for bontrdls even thougH the. hours of average wark per month were 
srightiyvhighef fdr participants--??.? vs. 7.4.2; It would appe^ar that 
participation, '.in suppo^^^ work liiay positively impact on^work 
propensities, but that W^ds of youth, who have been continuously in 

-tKe---reciuTar -labor: market* increase w1,t^ accumulated -seniority and. 
advancement to higher paying; jobs... This is suggested rby the fact that 
the- experimentil-controlt- differential widens dver the post- program 
deHdd- in favor of experimeriWls when assessihgs anpldyment rates and 
average hours worked, eveh though the avlrage earnings per month • 

n^i'dens— ia~favor-4>fl_^cdiit£o4s\_.__The immediate post-prdgram period 
results in higher crime 'and M)>resOareX"forTpart-ic-ip;ants-j'elat.iye to 
cdntrols, then.; there, appears-, to be - a , reversal in the 19r2? m-"^'' 

-periodv""In~iterms-of--drug^cind--aTcohol- usej-there are—minor 
ferentials in favdr, df cdntrols. in the post-^program period. 
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The: tenef it-cost ;method^^ be used 'to analyz^. these impacts and 

„. to determiri^; whether the; supfwrt^^ w^^ is worthwijile to 

spciiety. Under the in6st HaspnabV the. costs exceed Benefi ts 

by /a jiet present value of $1 315. pe^ society gets 



. l ess 'back in terms of output: :briine- and::^Ruql^buse-^ 

tax. ;paymeats7 reduced • transfer p^^^^ costs, and .other 

benefits than it -pays out.. Direct> transfer ^^i^e^^^^ are $329 less during 
Aonth_.pe£ibdua^ although 
indiredt. transfers {wages- paid in excess^of jjrodUctivity) uhquestionably 
ejcceed this amount significantly. " Transfers are not counted as a social 
benefit, nor is there any differenti^itlon between transfers tied to work 
. (i^.ei, part of wages); arid those paid" fegardlass During 
, the. jjiieriod of 'program: participa'tjon, iri'come/bf participants was roug.hly 
'> $1,344 higher than tha^t (qf-coritroisrind tfi^^ estiHated transfers (direct and, 
-irid:ire^t>^wepe_appr-oxim^ Oepehdirig; Vori .the valUe one might 



_issiogijje4<i^ h th^ ^^^ to c o r i s rder Ufff~exFgndTtu^ 



juftif-ie^ — Itf-dpesTTndt— appea^^ that" under any/ teasonable 

assumptipris the spCTal benefits of supported work for youth exceed the 

Jo.cial^c6sts-by-a-substantia1.-^^ — - > 
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0 In-Program Benefits - There is not comparable evidence on 
.InrPXogram ^^effeicU of other programs^ but it is certainly possible to 
increase ''enrTchmerftV' — or— to— consc-iously — tighten- -or_Joo seri the 
individual perfonnance" requirements. 



The impl ications- for work exper'ience as a program approach depend on ^ 
•ccmp^rispn of supported Wprk with Qthe^ of work programs, arid must be 
coris.idered . in light of the diS'advantaged ^^p^^ served by supported 

work.: No current work experience program has, as yet, been as rigorously 
evaluated as ijupported Work. There are, however, some conceptual 
comparisons in assessirig benefits and impacts: • • ° 

0 Output - Value of output studies conducted usi-ng the same, 
methodologyvas the supported work" evaluation suggest that supported 
work is almost typical in its Output per hour Worked, but ^as a Tower 
output per dollar ;6f program cost because' of the extensiye adminis- 
trative c.osts. Fftr iristance, a study of the 1979 " summer program 
estimated" a return pf $2.08 in .production for every hour of par- 
ticipation Given expenditures for training, administration and the. 
like, it is estimated between 55 arid 60 percent of the cost of SYEP is J ' 
returned in social productionj' this compares with 45 percent under' 
supported work. YACC returns close to. its^cPst and other local CETA ' . 
Work programs have: output in excess of SYEP. , In othef words, it is 
definitely possible. to mourit less ambitious administrative arrange- 
ments and to get. moire output per dollar of total cost. ' ~ 

0- Income Transfer, r Again because of the high- overhead, the income 
transfer effect . ;is, l.imitedv SYEP in l?78~paid out 84 percent of cost^ 
in wages and ..salaries; YCeiP paid out 78 percent; where in supported' ; 
work tlieie income support components; represented only 47 percent. .5 
Further, since these .other programs were incoma targeted, they , , > 

prpbably reached; a poorer population (although not necessarily one 
. with greater empnoyiTient problehis); • vl 
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0 R6st-Rr;bgfs«uh;-B^^ did not plit, emphasis, on 

pUceynt irid- ithe ;setV.1,cei deliV^^^^^ -Were Relatively isolated f ran , 
. ^CE% »pHiiie .sponsors.,, :;i;He-lpi?ceme^ rate iritp un^ubsidized jobs for. 

same as: siipport^^^ projects such as=^ 

Ventures inlCanroini^ ;t# thav^- been able to get yputh intor_ 

:.re1itivlTy?rbetj:i^^ J!!Ofds»;.Jt is; -likely tjiat 

pdst^^fogramrOT^^^ or can Exceed those realize^ 

supported!" w ' , * ' 

Suppbrted. Work (jeals wiJh/youth. vrfiO have, sev -Its results. 

' may haive; been different, wi th: a; J e^S; disadyanty ed; cli enteTe i On the other 
hand,' :it ;may alsb/'represe^nt/the;^^^ fbr such a group. The 

sUpfiorteJ work' cliehtBlfei most nearly ip^ral l:^! s^ that iri^ Job Corps > . The 
bejefl ts^ j iml^ cos i s: .qj^ Job " Corp\ Ji@^ 



liethotfologyr-^iitH; a"-^f:inl.^h§; ith¥i..^,behef.i ts substantiajfly exceed cqstS:. 
Perhaps; ybtftR of thj §{)e^ M^nefdJ: J_q§t from, be i ng 'removed fro m thei r 
eptr^bMettfw^ andr^raining rat|ier than just 

wbrk. " •■ . ■ - ........ ^ .. . 



Another |bptibn is to increase the human .resource development 
compbhehts as iwell as thej^tr^ansitton .services prbvided by .supported vwrk. 
The; suppiorted iWoric idaiiohstfation -hai {^^^^ extended with VEDpA funding , to . 
•test tha ir^latlivb; effec^^^^ such enrichments, jfuirther, there will 

be i> long, range fb.iloW?^^^^^^ and cbhtrols frm the first * 

phase; of -sujiported wor iri order Ito deteniiine whether the. upward trend in ■ 
employment folr experimental s' relative to controls in the, post-program ; 
peHod cbhtinues. on deten^^ the former participants catcivk 

- up to the- earnings; of control s... as a result of ^stained Tabor fbrce 

■ parti cTpatibn. - • ^ ^ ^ 

•There are also ' two -the'tfretical. issues which will requi re , ;nore 
. investigation. »Firsti bbth "displacement" and; "vacuum" effect?,: pccur-j v. 
i.es, /'some of :the .publicly f^ipded jbb,^ -O^splace tfrose otherwise furrded arid 
workers; who would :fj 1-1 thenii .,While-'-the net jbbs created reduce competition . 
and;tincn6a«^^.employm6nt probabilities for^^non-participakntf.^' The^extra jobs 
creatediji" supported; WrkV cjertajnly had, little* impact one contr.o3..^,- but 

■ presifma^^the: job j^ahs:^^^^^ least lequal the 'foregone • 

- earhtng^^f p|(htici^nti S% at riibst Bqual ithfe full j*age bill. In ^ 
other words, ihe employment chances^ 6f .al 1 hon-partici pants! would* increase, ' ; 
as the; competition; for ;Rarticipahti -This, iirpact would be offset 
Tib"~tjfe~/exteht .-the^^-'f^ for other^ise.^ funded • 
dnplloyment. thenwau^. supported^ butside regular' employment. • 
structures and; ^wi'tfr, the^ ha'rdfest .core participants .Would suggest that, the 

rate ,biv substirtiutibn: - wais/ s^^^^^^^ below that of public service 

' ■ einployment as r^gulariy^opi^^^^ that the vacuum effect was . 

small i.- Rbth ei^^^^ \ ^ -, 

A Wcbnd 1s'sue;?l'9 t^^^^^ trahiitibn prbbabilities. The baseline for 
meaWfin^i: impacts und'e^ Wqrk Wa^ the cbmparatiVe 

experience of ,exp¥r.irrientals ;ahd^ Without assistance, a portion of 

— -~youthl^l 1 be expected" tb gl£ j.obs.^ in any tiiiie period. Alternatively, , a * 
" — period of norimpl byment---betwVen— ^ by the job ' search . 



v.t 



9' 



theoiry -or explained by ,a youth preference for intermittancy in labor force 
participation. If * part;!cipants were 'cpmparW to a simulated, comparison! __ 
grdyi utilizing the posJtiy^e.^tffan^^^^^ group • ^ 

sMce^ the beq i nn'lng^^l^^ 
' sup ported work were assuired to have the same employment chances as^controls * 

who /were all initially without jpbs, the restive benefits in. tBe post- 
^ program, period Would appear-^greater^and— tHe-participan probably * 

subs tan tialljf exceed the -simulated comparis^^ group. In other wprds, if a 
job' merely keeps a youth occupied, when this job, is over he or she wil1\ * 
likely be wbrse .ofl^relative to a gi^oup. which had been in the regular labor \ 
force for some time, biit better off than ii\ the . job/ had not b?en available, \ 
Giy^ri the volatile nature * ;of youth lap^^^ part^ipatioo and the \ 

unemplpyment frequency associated with/ transition, a comparison group \ 
selected^ at the potnt^of exit might be/preferable to one selected at the/ \ 

po in t- -Of — eiitiqancei — rlmme diat o- p eysrt^-program — compa i s on s u r i defo ta te ' " ttre 

-:1mpactspof~worlc;expet^ " / ' - - ' \ i 

• 7 ^' • . ' ' \ N ' y I ' , ' ^ 

n — jhis report"On— supported~w6rl<~includ a detailed assessment of 

impacts and a benefit-cpsjt analysis 1 It. focuses on the youth portion only 
of the supported work experimeht,. wh^ich^also'.ihcluded offenders, ex-addicts 
and welfare recipients, there wer^ significant differences on impacts for 
thise different clienteles^and*^ the full reports from the Manpower 
- Demonstration Resource...X<)^ should be reviewed to^ pihpoint these 

differences. ^Jlbes^^reports include the > Second Annual Rei^ort on the 
• Na t i ona 1 . Suppo r ted Wb r k Demons t ra t i on end Summary and Findings of the 
Natioriat Supported Work Demonstration . 

This volume ts . one of ' the products of the "knowledge devielppment" 
effort implemented under the mandate of the Youth Employment and' Demon- 
str^tion^P^ojects Act of 1977. Tfie knowledge development effort consists 
of hundreds of separate research, evaluation and -demonstration activities . 
which will result""*^ ins literally thfousands of written products. The 
activities have been structured from the .outset so that each is self- 
' standing but sQso interrelated with a host .of other activities. The 
framework, is presented in A Knowledge Development Plan for the Youth Em- 
^ ploymept and Demons miration Projects Act of 1977, A Knowledge Development 

• ' Plan for the Youth Irtitiatives Fiscal 1979 and Completing the Youth AgendaT 

A Plan for Knowledge Development^ Dissemination and Application for Fiscal 
^ 1980 . ^ , . ; ^ . . ^• ^ 

' t ' ^ 

Infonnation is available or will b? coding available^ from these 

various knowledge de^velopment efforts to help' resolve an almost limitless 

array of issues. However, policy and practical application will usually 
require integration and synthesis from a widp^ange of products. A major. 
. shortcoming, of past research, evaluatioX and. demonstration activities has 
been*" the failure* to -organize and. disseminate the products adefluatel/ to 
assure the fulf exploitation of .the findings. The maghitude and structure 
of -the yguth knowledge development ^effort^puts a premjum ori structured 
analysis and wide dissemination^' . '/ . • , 

As part of , its knowledge development, mandate, therefore^, the^Office of ^ 
Youth; Programs of .the-^Department of Labior will -organize, puW-ish and^ 

* .dissOTfnate the written products v of ail 1 maj or . research, evaluation and'' 
demonstration activities supported directly .by or mounted in conjunction 



wtth OYP knowledge development efforts Some of .the same products may also 
pub^li sherf'-andHli5§emtnated-Hhrougj;r-bther--chanTiet^ 5«i 1 l-.be 

'included in the structured- series of Youth Knowledge Development Reports in 
ordeF to facilitate access aihd integration. .• • • 

* The. -Youth'faiowl edge^Devel opnient Repo rts . of which this ;,is" one,- are 
di,ividc:d i ntp twel ve' broad ca tegor 1 es : ^ . 

1. Knowledge Development Framework ; . The products in, this gategqry^ 
are concerned with thestructure of knowledge develo|wient%activities. the 
assessment methodologies which ,a,re employed, the. measurement .instruments 
, and their validation, the translation of knwledge into pol-icyi.and the 

strategy' for dissemination of- findings. '. 

■_ • '- . - ' 

-2r. — -Research-on Youth Empi bVnynt- and Empl oyabi 1 i ty .Devel ooment ; The 



products in this category represent^ analyses, of existing data, presentation 
of findings from- ^eyr data^sdurces, special studies of dimensions of youth 
labor market problems, and-policy issue assessments. 

3. Prograin Eval uatiohs ;■ the -products in this category! Include 
impact, process and benefit*cost evaluations of' youth programs inclu'ding 
the Sumraej?-' Youth Employment Program, Job Corps-, the • /Young " Adult 

. Conservjmon Corps, Youth Emp.loyment and Training Programs', Yoyth Community 
•Conservation and Imfirovement Projects, and the ^Targeted JobS Tax Credit. 

4. . Service and Participant Mix ; The evaluations, and demonstrations 
summarized in this category concern the matching of different types of 
youth wi4:h different service combinations. This involves experiments with 
work vs. work plus remediation vs. ^straight remediation as treatment 

"optioVis. It also includes- attempts to mix. dis.advantaged and more affluent - 
participants, as well as youth with older wrkers. , - . 

• 5. Education and Trafning Approaches ; The products in'tBis category 
present the findings of structured experiments Jo test .the impact and 
-effectiveness of various education and vocatiofi.al training approaches 
including specific educaj^ion- methodologies for.' the disadvantaged, al- 
. ternative education approaches and advanced career training. 

6. Pr#-Employment and Transition Services ;' The products -in this 
category present the findings of structured" experiments to test the .impact 
and .effectiveness of school -to-work transition activities, vocationaV 
^exploration, 'job-search assistance and 'Other efforts to better prepare 
\;^3{out^,/P'" labor market success. . 

»4i is. < r ' * • 

^-r^r ' TVouth Work . Experi ence ; The products in this category address the 
organization of work activities, their output, 'productive roles f6r youth, 
and the. impaqtfe, of various employment approaches. 

':8'. Inip^tementation"Issues :---:Thjs-v category , ificludes. ?trross-cltting 
analyses of the practical lessons concerning "how-to-do-|it." Issues such 
as learning ciirvesV" replication processes • and programmatic "ba'(;ting 
/averages" will be* iaddressed. under this category, as well as the comparative 
•advantages of alternative delivery agents. I * / , 



•9. Design and .Qrganizationiil Alternatives ; ' The products in this 
category represent assessments of demonstrations of alternative program' aad 
■delivery arrangements such as'-consol idatiop, .year-round* preparation for 
summer programs-,- the use of incentives, and multi-year tracking^ of 



individuals. 



V 



10. . Specia'l ^Heeds Groups ; -The products in this*" category, present - 
' findings' on the special pr obi feiiis of and the programpiatic adaptations needed 
< for. significant segments including minorities, young mothers, troubled 
. youth, Indochine^e refugees, and the handicapped. i ^ 

■ 

. U. -Innovative Approaches :' The products in this category -present the. 
' ' findings of those -actlyltles? designed to explore new approaches. * The 
- subjects covered .Include the -Youth Incentive Entitlement Pilot- Projects, 
< private sector initiatives, the national' youth ^ervlce axpefTnient, and 
energy. Initiatives ,\jr weatheVlzatlpn, low-head hydroelectric^ dam festo- 
' ration, windpowejj, and the like-. , • . 

12. '/ Instltutiohai Linkages ; the^ products In this category Incltfde 
studies of institutional arrangements. and linkjiges as;, wall as assessrrents 
1 of demonstration' activities 0 to encourage §uch .linkages with education, ' 
volunteer groups, drug abuse, and other youth serving agencies. > 

' in each of -these.* knowledge development categories-, there will be a 
range of discVete demonstration,' research and evaluation-activities focused ■• 
on different polfcy, p'rogram and analytical .issues: .In^turn, each discrete 
• -knowledge development project may^ have a series of written products, 
addriessed;^- to different ' dimensions -^of the issue.* for instance, all 
experimental' demonstration projects hcive. both process-.and- Impact eval- 
' uations, frequently undertaken by different.^evaluc(,t1 on agents'. ' F-hidings 
will be published ^s they "become aVlillable sd that there will usuall>J'be'a . 
scHes of reports a^- evjdence accumulates. To organize, tjjese products, 
" each publication ■ is classified in one 'of the twelve broad knowledge 
■ * development ' categories,, described in terms of the more specific issue- 
activity ""or dustier of arctlvities to. which it is addressed^, with an • 
jdentifier of the product , and what it'represents relative to other products 
in' the demonstreitions.' ...Hence,- the multiple^ products und^r a knowledgi 
develDpment- activity are closely interrelated ami the activites .in each 
broad cluster have ^significant interconnections. ^ f f ' 

. ■ •"' 

This vdlume-^hoyld be assessed .in conjunction -with other studies ,of 
work projects 1A the ' "youth work experience" category, /particularly 
Enhanced Work Projects.--The Interim Findings From The Ventures In Community 
Improvement Demonstration . .Because of the similarity of client groups and 
evaluation designs. We Lasting Impacts of Job Corps Participation also 
provides 'useful 'counterpoint... ' " . . ^ 



r 



0 



Robert Tgggart^- 
Admin is traitor ^ 
Office .of YouW'Programs « 



V -I 



5 I: . 



It. 



V 



It' ■ 



OV ERVIEW ' ; - . 

THE IMPACTS OF SUPPORTED W 



YOUNG SCHOOL DRQPOUTS 



Paae- 



. I." Youth Unemployment and Siippbrte * . 

11'. th& EyaTuati^b^^^^^ the Supported. Work ^ 

' - Pro g rami -Und^ - ' 

T lilv. Empldyrnent '^R^^^^ •' 
". IV. iricpmev In-Kin^^^^^ Related.Qutcomes 
.. V. ;Impact'f^^^^^^ , ' 

r Vi , ^Im^acts *brf^ C^^^ . - 

VI I-. Cbnclusioni/ ' ' . . . . '. 

• Appenclfx'A'r " 
Appendr;^ fB; - Asses^fn^ of Interview Nonresponse 

on^^Evailuaftioh R^lut.1^^^ 'j* . 
- Appendik 'C.-- jhe Effec of"°i:ength of Time Spent in^ 

- Syppprted-Work on Program Impacts 
. * References - 



. 23 
•59. 
107 

■ 1.19 
135 
151 
159 

. 191 

219 
227 



THE. SUPPORTED WORK EVALUATION: FINAL BENEFITrCOST ANALYSIS 



237 



1/ 



■■5.' » 

hr- 



I, - The-Suppprted Work-DempDStration and its Evaluation 

II. Costs and; Value of- In-Program Output - . • 
,111, Benefi-ts - / 

IV. Overall Rvisults for' the Youth Target Group 

V. ■ Compari son td: Other Benefit-Cqst Studies of 

Emplbyiiient and Training Programs t. 

VI. 'Conclusions 

References ■ . * 



239 
255 
291 
335 

345 
377 
386 



ERIC 



if} I : - 



13 



X 



/ 



THE IMPACTS OF^SUPPORTED WORK ON 
. YOUNG^SCHOOL DROPOUTS ■ 



W4 



Rebecca Maynard 
Ma thematica Policy Research, Inc. 



Thfe.^^^.g^^^ ot Supported i^ j^o; aid groups of jJropie-with 

weliresbttl^^ obtaiii^^ keep a regu- 

le^: job. ^ife a^^ ^!^^' btl»r iji^porl^ 

include r welfare ^ep 

dj^g"4??»^ ^^ 9^^^^ 3te -order; to assess ilie-pTOgram? s 

succei^s, a« S^year dero Msearch effort^ %ms uMert 

The f pui^, tiurget '^TOi^ focus: fqr^ t^ d^noristration 

aar^ .womi^^ payinehts liader tlie Aid to 

, Fa»il:3!es Witt pfepen '(AFK) -;prp^ f dr sn^stamtiad v 

peridd^^pf t^^ b^fn in dpxq treatstent 

j^jLograns;^ :^rOTi pris^ 

or; jail;: a^ wany 6 records of ^ 

delinquency; ' \ 

. -This raport focuses on. the effects of Supported Worjfe for . • 
young sckpol dropouts, fetw^ 1975 and Juiy 1977, fiy^ of 

the dessbnslJ^at^n Haxrtford, Jersey City, New^ York, 

and PMikdeiphia---e^ in the Stq^^rted Work evalu&tidn sample 

1,244 unjMipip^^ 

^chp61> bf feriiig^ xax^don^ si^^set of the enrollees (experi- 

m<rat:aulsr esqpl^ izi a'' s^^ for iqp to 12 or 18 

months/ dej^ding oh :jthe^ si^ assistance in findijag ptter^^^^ 

iployment asftt^ heared its end. ^lOiile 

interview data covering .a±^ fi^st 18 npntts following 

enrplinent. eure ayaili^le fo^ only 153 j^uth jMh^ enrolled 

in the :san?>Ie pHpr >to^Apr^^^ 1976 tebilq^Ieted a 36*tBohtli ihterview. 
Thus> conclusions cpnceri^ of Supported Work 

are- subject to corisidewb^^^^ iuiceri^iiA «^ ' ^ 

The general cpnciUsipns from this sttady axe that the avail- 
dib^ity of Ta .Stqppprt4d 'W6rk* job had ishort-run iinpacts on .emplpyxneht 
ahd>^ consequently # on dependen^^ assistance^ but that the 

program do4s nbtfAPPwr td^^J^^ objective pf miti- 

* gatiiig the .long-run pf this disadvantag^^^^^ 

of the yputli i»pulati6n>^ vPur^i^^ there is; littt 

'that Supported; Ito^ ipng-rtui iiaa^^ 

<irug use or their^ crime. The key research ;findings 

on which these, concl^usion^^ are siamnarized in Table 1. ^ 

Employment juidvEain^ ' The large employment gains 
of lexperimenta^^ TOnthi after 

ehrdll^l^ht^^^^^ jjficreasrd 
tReit :^spi6yment^ 

left their Supported^^!^ !)'•' By 

^the start of /tAe .sec^ when less than 20, 
percent of the e^4rii^ still in the 





Coatxol 



•jteiitii»:i6 * *xa^ * 
- >ioith«; 2S ? '3«' ^ I 

libfttiw id • la" 

AvtnMft: total Zacoas 

.Mtiiirld • It 
:iioatli».19 r 27 
Noatbs 2« 3« . 



' llBatbs 1 9 
MoatbsJIO r 18 
Hoatlw 19 * 27 > 
Mtlit 28 « 36 



97.6 
68.0 
61*5 
74.0 



U0*4 
69.9 
68.8 

.88.6 



$338.68 
' 239.63 
26>»92 
301.94 



,$391.0S 
287,-39 
331^67. 

: 353.47 



$ 31.59 
32.32 
46.50 
44.22 



.53.3 
60.2 

' 61.0 
65.9 



39.7 
58.2 
68.2 
81.4 



$U5.48 
196.a 
248.a 

336.33 



$176.04 
26S.44 
3U.68 
408.0t 



40.37 
48.44 
54.U 4, 
54.79 



>I4.3** 
7.8*« 
0.5 
811 



80*7** 
U*7*« 
. 0.6 
7.2 



9213.20** 
33.15* 
1S.44 

• -34.39 



$215.01** • 
21.95 
28.99< 
•54.54 



$ *8.79«* 
-16.U** 
-7.62 
•10.57 



Ptre«ac«9« ^ ^t^d Any Drug 
^"Jmz TtM 3laxijuaii* or 

HoAths r^9 ^ 
. sibcttto 10 - 18 V 
itootbs 19 - 27 
Moiitb8.28 - 36 



U.3 
10.5 
U.O 
16.3^ 



14.2 

10.2 
10.6 
U.O 



•2.9 
0.3 
0.4 
5.8 



y Mbnths 1 • 9 . 
Hohtbs 10 18 
yMtbM 19 -^27 
U Months 28 • J6 

Krcoata9« Who asAd 

Xleotel b«lly 
Moathii. 1-9 
2toathii 10-18 
itonths 19 - 27 
' Stonth* 28 - 36 

Indicator ot Crialmq iictti^ti 

PtreoAta^o ArxMttd 

Mbath«a - 9 
' Months 10 - Id 
. Months 19-77 
Months 28 - 36 

/.Months 1 -18 
- Months 1 - 27 

Avorafo'SToMbor Arrstts 
Months 1-9 
Months 10 - IS 
Months 19-27 ' * 
Months 28-36 



56.9, 
52.8 
57;9 
64.2 



8.1 

^U.2. 

io.6 

7.3 



17.1 
16.3 
10.3 
10.3 

26.7 
30.5 



0.26 
0.21 
O.U 
0.27 



52.4 
51.2 
57.6 
64.1 



5.5 
9.3- 
'9.9* 
8.9 



16.3 
15.2 
14.0 
16.7 



27. 
39. 



0:20 
0.18 
0.16 

oas 



4.5 
1.6 
0.3 
0.1 



2.6* 
1.9 
0.7 
-1.6 



<?C.3 
1.6 

-3.2 
6.4 

-0.3 
-8.8* 



a?06 

0.03 
-0.05 
0.09 



Hons thsto data aro roTrosslon adjustad. Ttio naximai saspU tlio for rasults during* aontba 1 to 18 it 861, 
. that for rstttlts during aonths 19 to 27 is 513,* «nd that for roaulta dtttin? aontht 28 to 36 is. 153. 
All fiqurtt partaia so zbM total «a«pla. v . * 



*fU8is'tioally si^nificMt at tho lo.paxeant: Irrtlr^ tvo-tailsd tost. 
*.*f^eiatJLeUly ti^f^ at tha.5 pareant lovalr tvo^tallod tatt. 
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Mpntihs' A£tef lEnrbilneAt in the D^nvohstration Saunple 



^1 



NOTE: .Exjjariiaanti^^^ are signiixca^^^^ from zerp^ 

6nly'duri^ 




-^overkii'^^ • " The 

awragl^g/be^ 



^Reiatiyelx^^^^ 

stration^^^^^w^ :f aced %e;;E<^ 1^3^^ ; ' 

thos^' ijiKNe^^^ ,and^|W•^i^^ :i(id- 

those :Whb were ,;ybunge^ than: average : : ^Qweyer , tiiiese 
findings rgeneral^^ Vere: nd<^> statist^^^ si'g^^ 
_and^ ,sb :ark dnly^^sug^^^^ 
to focus .ihei:?pM stJjset of y^^ 

be^'pa^rtici^^ to iienefit: ;fr6m Supported* Work. 

Ej^^eriinehtwa yd in .SupportedrW^^ longer 

than controls^ stayei;!^^ (6.7 iabntd^^ ' 

versus 5:. 6 jwn^ for jho^ jobs) However > 

Ibhger' t^ure 'iiv Sup^^ jobs has 'hot. been 

found'^tp^lre^lt^i^^^^ other (Itmerisions. 

of en^ioyBbii^^^ such as eznployment 

rat^s^^ tei»pI6:^ rates. Siiniiarly/ . 

the; Suppor^e^^^^ eaqpferience^ sub- 
:stauitlalX^^ jpb?: afepn^ bbth 

experii^ .twp^tid -^ee-^. ^ 

qiiarterii: of non^progpca^ jpbsrwerje^ih: mMufacturing, 

retadi trade >;*'and^^ were 
nwdhiy- th clerical/ :servicq>^ and fiisceH^epuis' 



Total Income ^emd Welfiure ^ Not sua^ris^ 

giyeiir the> 'en^pibj^M ^Supported Sfork; -ha^^^ 

sho^rte^i Be^ in st^ 

fcdgte^^^ -stamdircls of; iiyiixg^ aiiwll^^^ 
rto-^ta^ipayiers^ 
HbweViar^-as ei^ 

jobsv, ithelx/'- 1^^^^ incbme* price; agai^^^ app'rpa^^^^ 
of tli^i ?pn^^ V^^ibhyh^d^ 



bver ^€paei-' 'Si3:: a resulfc of :;ijicrea^ earnings Despite 
thfe . upward trmd in .earnings,. Welfare pay^ , to both 



controls iij^«^ased in ra^splute 
amoimt ^ntany youth 

'tod; es 0?m; fiius^ and' benefit 

ievelsnrcTse, oyer ^t^is jEHsriod However tfte^experi- 
^»e'rit^rs7"Sy^^ xeMln^d consi 

/aJiSDul ;$10: to*^ coniirbls. 
;a ^partia^ explMation^^^^ this^vpe^^ ^reduction 
ijn;."t^nef^ their 
: ^higher ayerage^^:^ . .cqnpensat^ f i^s * 

, durdUig ; :the lO*^. ;tb' ^i27rTOnt3i: period after enrollment . 

Thus'v 'VrtiiTeT j^a^^ benefited sub- 

stamtiall^ there was 

.lit:1^e con^ehsa^^^ xti xe'cei^ frqi^ 

trcmsfer^^ jOyer .ItSe ,£^^ of the, 

deanohstxat^^^^ participa^^^ experi^ income- gaii>s' 

-ayeragi^^ lj9pOT^o'f^ffic^^ 

'rec^ived''4i^^^ in Supported 

.Work)i^ a.^reduct^^ fpo^? stainp'^b^hef its 

of; ieffs thiw^^ in Uhei^loynusht 

Coi^ehsatibn benefits i?130, v> 



Drvig Use ; Supported Work had no overci;Ll impact on 
the .prevalence o^ da^ use. During iaach fo-llow-up 
period; between 10^^^ 17 percent of both experimental 
ahd^ cohtrol youth used ^ome drug other than marijuana 
or alcohplyJSl-to^e^ used marijuana/ and &:^6 

11 percent- used, al^cohbl every day or nearly every day. 
Pxirthermore>. there is 'xio strong 'evidence to suggest ^ 
that,, the program had significantly different impacts' 
for individuals with -particular characteristics, nor 
is there ;a consistent relationship between experimentals ' 
aM controls* ^rug. use and their employment status. 



Criminal Activities . On average ^^T the Supported Work 
. employment 'oppo^ significant impact on 

criminal beKayior ambng safitple youth,: either diuring 
,the .time when experljnentals were in. their prdgram 
;|^obs or st&seguehtly; Diiring etch of the first two 
:9*month' periods ,^ adxiut ^17 percent of /both experimentals 
and controls' reported 'K^ arrested and, among 

those arrestedV the average number . of ^arrests was 
•between 1>2 am^ l.S. Between 15 suid:, 20^ percent of ' 
these arrests were^/for. robbery,.' biaring the 19- to 
27^m6nth> period,, a lower per centag^of" experimentals 
thari.contrbls reported tJi^ occurrence of an arrest . 
{JO .versus W/.pMce^ while hot 

^statistical consistently 
more ;.favoriible- response among 
those, eiarilest -ehrbl3|rees-^hio .were followed fbr at 
least 27 rjioriths a^^^^^^nifcdllment. However, by the 
28^ to 36-hbnth'jp^ifxd^ after enrollment, there 'appears 



1^ . 



\ 



1 



to iH^ rib^>^^ -lajpac* of ^ Work 

;i^«trlt^ -^tiiAt^'jpfogrtta^ 

- ^'cmplo oonslsterit 



vite6p6tttt ;Jtoi%-p6n's«q^€m^^ of. ^ 

'bf-'lSuE^ by':«ri 

jiveragi iof W^us in aisesi^ vhathar 

or hot Su|^^ fadarally a^^ programs 

itt€fflfti>tiJig;^ to ljnE«»rtant to 

vaigh aiisWy/ coat^ tha social phjactiva of achiaving^ 

ielikti^ 8hprtr.t«fm es^ioymBXtt and incoibs gains. 



"S' "-J 



50 
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;CHAP.TER i ' 



.:YOOTH UNEMP J^p .SUPPORTED WORK. 

> . .'Arohg cert^^ in our society> empibyinent: problems are 

paurtict^a^iy and persistent. The sourcen p9 these problems 

iure vairi^Mcl, but. major ,-factor^^ iack of .ep^erience and training,^ 



, ;Popr/.wrk/hifbit^ insufficient mbtiyatipnr and discrdjaination by enployers. 
^Bcixo^zikq the serious: coii^eq|aences. of these eiqployinent problems/ both 
to the individual^ society, a consortiium of Federal 

igahciest-with-the^p^^ undertook a 

major demonstration of Suppprted Wprk ^programs. These 

prpgrMis "pr^ide work experience^ for a yeas^ or so,^ lihtier. conditions of . * 
^:graduaily increasing perfprmance standau:ds> close and supportive^' super** ^ 
. visipn, ahd-peer group support. "The four target groups that were tlie^ 

focus: ipf this derons^tratl^^^ include long-term recipients pf AFDC, ex- 

' . * ' ^ • ' 

addicts r' ex-'Offenders/ and young 'school dropouts. ' 

Thel evaluatipn component of tlie demonstration was^ designed to 

'measure the. econondc^ ^ i^acts of Supported Work. To facilitate 

^ this research objective /. 'ijl 10 :pf the dsmpnstration sites,, eligible 

applicemts^ to .Svipp^^ .assigified to ciither an 

"eiqperjjflimt grpuE>vamd.6^^ Suppprted Work jpb pr to a control 

•group., .Saaple mendbe^t^ then ^scheduJ^d to be interviewed ; at entollr 

imerit^and. at' ^lise^ to three yea /sT 

^ ^ '^A ' . The main! concern' of this report, is .to assess ^the extent to. which 

Supported; Work is^an, effective prpgram* for mitigating the .chronic 



emplpyment- problemi faced, by youjtti/ paucticularly school, dropouts and 

; . • \ ' - 1/ 

those- from . ethhi minority groups who face- the most severe problems.-^ 

/In recent years, federally funded eit^loymtot"*r&l&ted programs 



have seryed. over 7 miiiaoh youth per year, yet high unemployment rates 

have persisted.. While the immediate, and Xonger*nan, cdnseqiienc js of this high 

unemployment -rate: among , youth., garticulairly minority yputh and school drop- 



puts, are. uncertain, it* has been suggested that in the short rim, 
unes^Xoyme^ may increause. th^ .likelihood of involvement in .crime 

' ""'^^ ^ ^ ^ ^ ,r . ^ ^ . / . 

(Singell, i967r Mihoney,/19787 Punke, 1978;, Elliot and Knowies, 1978) 
and, the. use of drugs (O'Lkinheli et al. , 1976), and^.that in the Iqnger-run 
it may tend to perpetuate enqpl^jyment prc^lems, (dsterxnan, 1978; Adams and. 
Mangum, 1978; and 6iPrete, 1978).* Tliis chajptpr discusses the sojirdes of 
youth unemployment, publicrpolicy approaches to alleviating the problem, 

evidence of the effectiveness of these various employment- related 

^ } • ' ^ . ' 

programs serving youth', and the role pf Supported Work in th4 nation's 



youth em^^oyn\ent policy. 



A. SO/JRCES OF YOUtI UNEMPLOYMENT 



As cam be >een in Figure I.l, the unemployment rate among youth 
rose substantially between' 1960 and 1977* since which. time there has- 
been 'some decline coincident with an overall improvement in the enploy- 
.ment situation. A number of factors 'are commonX^ cited as ^contributing 



— ifhe unen?>loyment rate"'^ESong black youth has 'been more, than 
twice as ' large. ^as that for white youth, and that among school dropouts 
is between 55 ^ex^rent' (for >iftck youtji)- and, 78 percent (for white youth) 
higher than among' 'school 'gwduates (U;S.-*4Department>of Labor 1978b and ^ 
Bureau of Labor'^ltatistics, i978) e , 



FIGURE la , • p 
Tj^P IN NATIONAL j^^^ 



ai<ick.,kit«l;OtlMir 
16-. to 19-yMrr01i(« 




Mliit« 16- to 19-ytiar<-01iUi 



totkl ropiilAtiofi 



"A 



. r I I III uutV ' ' ' ' ' ' ' ' ' ' ' ' ' 

i960 1%5 l')70 li)75 -J 1979 * 



SOURCE: • Employment and Training Report'^of the Plresident , Washington, D.C.: U.S. Department of -Jiabor, 1978, 
^ and HEWS, Washington, P.C. ; ' U.S^ Dejpartment of Labor (various Issues) . . . ' 
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*to the persistence of these high rates. One *is the^pw skill/levels and 
-lade Of eo^riencef of joaany df 'thes^ youths which^ togetheriwith the rising 
niftiaum wages, may tesult in an unwillingness a&kohg eo^loyers to ^hire * 
";*outh when adults aa;e available for work (Barton and Fr^er, 1978) • 
Another ^ause .may simply be •diicriaihation 6n the part of jesployers 

A.(Dia»ond^and-Bedrosiani.l970) * Yet "another factor influencing this 

^ , ' ' ' . • ' ^ ' . ' ^ I 

growth in inenqployment is the increiise in both thia youth- wDpulation 

- . * . * [ • , • 

and its civilian labor^force participation rate at a time when the 

. . ^ - • - • . ;H : ■• 

participation rate among women, in particular, was also increasing. ?or ' 
example, between 1967 .ahd 1977 the total labor for'ce increased by 26 
percent (from 77 tp 97 million persons) ; two-thirds of tiiis total- increase 
was youths age 16 to 19 and adult* females, who together had rdnstistuted . 
only 40 percent" of the labor force in 1967 • These 20 million new « 
entrauit Shinto ^e labor force were faced with an increase of only 16 
million jobs and, for a variety wf reasons noted previously, youth 
have been relatively less successful than. other groups in con?>eting . 
for those jobs. , ^ , * 

Exacerbating this general rise in youth unemployment has been 
an increase in the duration ofc unemployment spells^ In 1966,^ only 
11 percent of the uneii?>loyed 16-^ to 19-year-olds were oanemployed for / 
as long .as 15 weeks; by 1977^ this figure had risen to 15 percent. 
Since mu<^ of the youth unea^loyment appears to be . due to moYeoc'^ts . 
in and out^of the labor force, overall unenployment rates may be affected 
considerably with only small shifts in the duration of unemployment spells 



"■4. • 



•■ Clark and Sumners (197.8) provide evidence of a substantial 
-portion of^youth unenployineit. being related to the high rate of movement 
in and out of thc-labor force. ' ? ' •' • 



, ^ ,lh th* ipia't covple of -yeaDcs/ thsri has -been sqne general ^ ^> > 
iM9?^y^vmnt ix^: p^ .econqny which/' together with the increased federal 

•penmntf, for youth e^ has JLed to some in?)r6veinent \ ' 

• . • ■ • ' " *^ - /C ' 

. in tho^ypijWi eifl^loynwit sitxiation:' , unpicployiwTfit.dropjped from a high ^ 

•20 percent in J.975. to? 16; percent during the first half of 1979. H6wever\ 

■ ■ . , ■ ' ^ ■ ' •. " ■ ' • ; • c ' ■■ 

' a disprbportionate slutfe of the .gain in' «i?>loyiaent was among wW.te 

■ • ' • ■ . . . ' - • . , <• 

■ youthJMho ha<^^6oB??let«d^^ J - ' 



B. ^POWqr MEANS/TO KEDUCE- YOUTH UNEMPLOYMENT ^ " ' . 

" ■ ■ ' \ ' -"^ * : ' 

. • * ^ response to the persistently high unemployment rates, iuabng 

* / \ : ^' ' . - . ^ " ' " 

youth/ teere has been a " continual esqpaiieion of programs designed to 
. iB^rove. their eaqploynJftht. opportunities. Such, programs have tended to 
, • focus dn increasing Educational attainment ^ improving job skills, and 
prdvi^gViifbrH Mperience. ' , 

- ^ The first, such prograaas. were institutad under ^the^ Manpa-/er 
Develiiwicnt and Training Act/.(MDTA) aauMidments of" 1963, which emphasized 
job trainxsg and . retraining programs. These were followed' closely by 
the Neigkborhobd Youth Corps (NYC) and Job Corps, v*i£ch.,Here established 
under the* 1964 Lconprnic Opportunity Act. . The NYC provided work 

* . * J r ^ ■ ♦ » ' ' 

' experience €o both in-school and out-of-school youth from low-income 
farllies/ while Job GcTrps.was a more'cooprehensiVe residential program 
which provided remedial education/ skills training, work gxperieftce, 
. counselling, and. health* caie;^^ These three programs together served an 



' ' 1/ ' ■ ' : «. .. 

. -^i See Tables' A*S and 3-8 in The Employment and Training keport ? 
. ^of the President , U.S; Depajhmieht of Labo 1978,. and. 

recent .issues of tfeWS: The Empl6yment Situation , U.S. Department' of 
Labor; tWMhi^ ^ " ' ' ^ - . 

T *2/ ' ^ ' I ' . * ' 

> See Xeyitan and Johnston (1975) for a descriiption of the Job 
Q Corps- program. " ^ . ' . ' * '\ 



|^tH^^:^V/:,„ ^ .\ • - ; « ■/ - . - ' - ^ . • . J 

viav6ra|e of 500, OOOi yout^^ 1963 to 1973>; yet the total . . - ,\ ->| 

.4^,nunb'er 'O^ unemploye^^^ rise, .smd %e*^per^^^ 



« ' .\ .ihi^^cpgnition^^ .the fact that the, causes of and the jieans-tQ 

reduce une6q?lbyiM»t v^ied widel^^^ segnieats of the- une# 

£tol>ulatibh .auid ^ labprrmarket the Cqacrehensiye fE^^^ 

ahd Traixxiiig Act (CETA) Was enacted in 1973 to peannit inudi greater Ipcal 

aiitonojay for eanployrcht poll This act provided ^ 

fiihding for a « number^ ^® 

Ei^loyabxiity DeveibpmSat Prpgrajh (CETA, Title 1) 7 Public Service 

Employment (CCTA, Titles li W VI); Selective Segments Program (CETA, 

Title ilDf as well as the Job Corps (CETA^ Title IV) .-^ By 1977^ . 

these CETA-rsponsored programs^ together with other federally funded 

programs, such as WIN (the Work Incentive program) and the HEW-sponsored 

'.vocational rehabilil^ation progrinsr served 2.7 million youth. 

More recently^ ttfe Congress has greatly e35»anded en^loymisrit 

services for youth through the 'Youth Enqployment and Demonstration 

/ " • ' 

Project Act (YEDPA) of 1977. A, major directive of YEDPA, which provided 

»' * • ■ 

jobs to nearly. 400,000 youtii in fiscal year 1978, is to issgxtvo. our 

■ "",_'■> 

^ - ♦ ' 

knowledge of -the cjiuses and potential xures of the employment problems 
of both in-schooi and, out-oic-school youth. The Icnowledfge development 
plan for YEDPA includes both assessments of ongo^ing CETA programs / 
, such as Job Cor^s and the Summer Youth Employment Program (SYEE)*; and 
demonstrations ixi the areas of public-- and private-sector job development . 



V These! CETA titles refctr to tho^e prior to ^ the October 1978 
reauthorization. I 



fftd wage vouchers,- and grograins aimed at various Special 
-segnents. of the imei^loyed still extrolled in school, 

delinqpi^tSf r^ . i 

C* ' VOHCiXSlOU^^^ OP OTHER YOUTH EMPLOYMENT PROGRAMS 

In large 'part> these vaurious' Etoiicy approaches to alleviating 
youth 'imeii^loyinent p^ motivated by an einerging literature 

ttot provides' theoretic^ for -hypotheses concerning 

the-geiieral- causes, and cohset^erices. of unenpldyment* A brief review of ■ 
this literature provides liseful background information for subsequent 
discussions 'of the goeJLs an4 expected effects of Supported Work programs 
for youlih* ' ^ ^ \ » . 

The first major category of ^literature discusses jeaployment 
^is a fimction of factors either inherent ih or being attributed. to the 
individual. According to human-capital theory, education, training, 
and labor-market eicperience constitute the iii^rj:ant determinants of 
en^io^neht opportunities and* labor supply.-^ The wage' rate one can 
earn and, hence, one's supply of labor ^increases with the level of 
human capit2d^» And high unenployment amon?^ youth, peurt^cularly young 
school dropouts, is thus eicpleujied as due to* inadequate human capital. 



ERIC 



1/ " • • , 

See The Employment and Training Report of * the President - U.S. 
Department of Labor, Washington, p'.C*, 1979, and^ A Knowledge Development 
Plan for Youth- Initiatives Fiscal 1979/ O.S* Department of *Lab6r, 
Waishington, D.C*, Decismber U978 > for descriptions of these research 
and vdevelppmeilt projects* ' • ' 

rt Beckeqp (1962) provides the foundation for much of this 
literature* Otiiers making significant- contributions include Ben «. 
P9rath (1967)> Blirder and Weiss (1976) ,\Minc6r (1974), and Sewell afid 
Hausfer (1974); 



: 13. 



This argument r especially whenrap^iiefi: to the iow-iiicbme^.j^^^^ ^ 
.h*^.fbeeh chadlenge howeveri^ Accordiiig to one altenijiti^ 
^dual.^^^^f^^l?^^^ ^^^^ to db.scrajaxnation xn. 

,^e l4bor of^basic^lg^s (Dperinger and Piore, 

1971r. Gordon, 1972; /Haurane^ 1971) # witii youth and those of limited^ 
educatibh .thought to" be ank)rig, the. groups <UscriJDUj:^ted. agau^ .^et 
another view of the worJcxhgs'of the labor raarket; is that education ^nd ^ 
teaming are uised as. s^creenihg mechsuiis^ to deteriuuie^^ ^^^^^ whom jo^ofters 
'will be made: and at v^iait wage rates (Thiarow, 1972); once again, youth 
wall have fewer credentials than older members of the labor forc^ and 
so- can be 6^cted to* experience ^relatively high unempioymeht rates. -'^ 
Still other literature points to such institutional constraints as 
minimum-wage legislation as important in determining emplpyinent by 
restricting dfema^iT^CseeT^ examgle.y Gramlich, 1976? Ragan, 1977; King, 

1974). 

A* second categqty of literature discusses theoretical arguments 

■> • 

and eii?>irical evidence in support of the view that uneirployment is 
attributable to differences' in labor-supply decisions themselves: 
individuals weigh the monetary gains from working against the costs, 
which include 'both the value they place on alternative uses of their 
^ ti me and work-related expenses. A number of factors may; affect the neft 
monetary gains frpm working, including various tax rates {particularly 
the 'income tax and the intplicit welfare tax rates), expenses for such 
items as child care and transportation, and foregone home production 
activities—npne of which is expected to be particularly butdensome 
for youth- as compared with other subgroups in the pdpuiatioh* However, 



•sb%?haw yai^e on leisure 

, ^^1®?/; SWIfy; *^^^ stii^^^^ their sparents for ^ ^ 

support; limited :heed" Mney^. Accprdi^^ to this argument , 

the reiati^^^ ' auid- exit rates for yputh- are 

^P^^se.they ,tend to-be les^''Viiling,.^th^ groups /to work steadily 

?t preyailiiig^^^ rates XOsternianv .078; Levitaln. and jBelous,^ 

*i®6d: a^ reducing, ^amohg special segments 

9? the:p^ in wKicH Yp^^ represented or among, youth 

specifically 4iaye been as vaxied as the theories concerning its causes. 
They include Job Opportunities in the Business Sector (JOBS) , Opportunities 
Industrialization Centers (OIC), the Concentrated Employment Program (CEP), 
Job Corps, the Neighborhood Youth Corps ^ (NYC) , variotis progr^ Sponsored 
under CETA- legislation (incliidi^g the new YEDPA programs) , and numerous 
small demonstration (or experimental) programs aimed at special subgroups 
of youth— particularly delinquents. While there is a sizable liter^ttire ' 
descril^ing many of these programs, most programs, unfortunately, have 
not been carefully evaluated.-i^ Furthermore, the methodologies employed 
in the various analyses that have been conducted often differ* sufficiently 
that cross-program comparisons' have no meaning. Despite these short- 
comings, a brief summary of the' nature and impact of some of these 
alternative strategies may provide some insights as to the likely effects 
of Supported, Work for youth. 

The JOBS program was deisigned to overcome employer prejudices 
and discriniination in the hiring of disadveuitaged persons, among whom 



. 'r/ - Thosje.prog^ .wder ;the Youth Emplbyrcnt Demonstration 

^•rqj'ects Act .fYEDP^i^'p^^^^ tlSo ,n4w to have been subjected, to more 

O ;tiMui, a descriptive anfldysls', eyen^ thpiigh. ^re tiiozrough axiaiyses are planned. 



i^dftfil ;l^y foployers (GriBiehljai^^^ Associates/ 



^ *-v ^ 



.In cdnBast to iqas, ;titie 6ic\-progr^ was oriehted-i^pw^^ 
,pr6yiaipn,.o. Eyaiuatiohs 6| toe 6lC,; ,.i^ic^^ .. ' 

h«yi|.:baen. based „priJMU^^^ isi~px6gx f or pro|rw^jMt^ 
,oSly> 'i«e iiiadequate^^^to^^ - - 

The a|P wa^ designed, to help- youtii^ ©i^loyer discriiiiim^^ , ^;>: 

prijharirly by-^^P yptith with some emplpyrcnt e>^ sub8e<|uent 

job-search assistance. Ctoe of the inost QdnprehsJisiv^ Valuations of Cra 
(Mriclmer'As^ociateS/ 1^69) , which relies on a^cpi^arison of*>piueticipa^^^ 

behavior before and after: participation in CEP/ suggests that the program 

, J- ^ #« * • ^ •» ' • , 

led/tb postrprogram Q'ther evalu|ti^ons have 

.arrived at more negative cohclusions, however, perhaps because of 

aiethoddlpgical differences , crd^s-program differences/ or both.— 



' • " ^ J/* perr«v^ et alV: Cm^^^^^ 
■everai other .eyaiuations; ;of tliis Ji^rq^^,; which focus on somewhat 
different performahc^ crit:eriav«^^^^ i'^ ^'^me, rcase^,. arrfye at 

di^flrwit tlK>ugh nol necessaril^^^^ ihcoh^»isteht^cohclus(ions 
" " ■ 'a- ■' . '\ '■ ■ ^ - - - V „ ; ■ • 

For eicanqple, s^e Barry (l973")-, 6ly%us Reseaucch Corporatiori 
(1971), Scott (i?6^ Peterson >(196.8)rr %d' and 

Young"' (1968). ... , i . ' A ; 

< ^ For, exai^le./ Ashienf^lter (1976) discusses th^ potential* 

.gTOibl%M ;in; evaluating the .* ' 

v^£f|'rts;-of\mi^ • " 



'jl^^^'^I.^V^/Mt ^tjjie ^oyeraii.;,effe^^^ .eaployment, of 

-., - ^ jprogrM^Vvwaarrestruq^^ ■«n|>jSMis"on' skiil deveipjpn^nt, 
t:' • , •■#4/ %^¥S9^^fP:^^Bi^.ii^eis :to6verV tii^t^'^Bpnoiiiic. inmacf of the 
: . - . l^^stjcycti^ not; >Qj B n ;c a ie|ul^ aGseas.ed. — - — ^ 



I befh: tie ocjus^ rpf nraieroxas evaluations . .Since 

'i^s^.4Acept:^^^^ this prp^j^am^;^^^^ oh provia^ 

^f^HP^Iriof^f of sj^pyrji^ce assistance in jresidehti 

■1 cent^rs^tp youth; if pm a >backgrqynd>cha^ac- 

terized^^^ depriyatfon?^^^ who, in terms of backgrpund, 

^ch«acteri3tics, k±e f^xy::p^ to those yoiith enrolling in Supported 

/Wptk. Evaiuatibhs dufingi. jpb^'corps-' first -few yesCrs of operation provided 
?ujce<i- evidence o^ the, pTOgramls .ecoh^ impacts.-'^ However, more 
recent, studi^^ comparisonugroups and more 

rigorous eyalu^tibh tecimiques have- shown that> in cdhtrest to other 
e"^l9yn|nt:;^^^ for youth,, the Job Corps program, operating 

4?'1^^/?^d'^ to late seventies dpies. seem , to 'have had favorable econom i c 
:aAd::nonecqnomic i%^cts on participants,. Among the most noteworthy 



On, average >;ieye& after ieaving the program, former Comsmembers 

# '^.9l^«e4 wiiJi isiy^^ were mor.e likely , to- 

Be e%i^yed fuil ,(27 y4r^u§, 24 percent) , earned higherVaverage 
McoTO- ($212 versii? >i:94 Eer.,m6h€h) ,and less dependent <^n welfire. 



> :\ , {'y-' r (1967), Cain 



i 



ih\ tftft gob Corjps^ jgpact^^bn j obrseeldniL 



^t; vOiis ;l>o'iat' it ris^^^ coiitiant : oh the f (aw ^i>reli^^ 



3 



1^ 



refiUts^^ there eu^* of .^vf^^^ federal^ 
,pr6«aa8 :to/cp «^ch M the Youths Bttp^^ 

%aiiiiiig. Progrim/ the: Su]^^ tojjloyi^ Programs the; %urig; Adult 

Conseryat^^^^^ t^e Youtii :to Piiolt :P^^jects, the^ 

, Youth^Cpmmw^ ccnsejn^atip jshd hurcrous ^ . ^ 

smaller Title;!!! 6^^^^ - 

:Bas^<i oh this^ieyideh^ we are certain ^ / 

jif only one thihgrrthat youth un€m5>ip^m^^ 

require'a variety of. tyreabaents. On4 of the biggest, jobs of' fut 
evaluation research will be to identify which policy or prpgraiq:.pre- 
scriptibns successfully addresa the enqploymeht needs of which group 



of*"youS>I^ ^ ' ^ ' . _ 



Sinc^. i975,. eight .of tihe hatioM^ Supported Vtork ^deTO 
programs have been prbvidingra specia tenporary cutqpipyMn^ opportunity 



-i^" A nuxaber of other cffljplpyment- demonitira^^^ 

.youth have f ocused p^^ 6A .outcpwir.^ i'9-'^)^9y^^j ■^^ 

are ridt partic^afly xelS^^ this dULscuasio^ For exiurp 

et ali (197i). ihd Clarke a: description of daronettati^^^^^ 

iiBiad maihiy at Jdeliifuiiii^ These studi^^^ 

cdnclusions conc^ 

lioWeViar^ Hey-hi$i^^^a^^^^ limitaeicns ranging from small . 

:^«BpIe8^tp;^^^ * - ' , 



fhf tor ti^B^.Sv^ target grou©^^ 

:8et^p£riuppo styhictjj^^ 
P^i^^^^l^^ for transition to enpioynent 

»^Icet dfter. a vWkina^ of 12 to 18 i^^^^m 



Pttticipita^ i%: a Su^ Work job. A supportive, vorlc en^rqninent 

is proyid^ assignnieht^^ crews of peers aiid tteough 

•ctoie ; «t^E^^ ijidiyr<iiiua» who IxJthjmdeM the WorJc histories ' 

piaaraohai crew menders and will enforce- griui 

incraM^ ati^endUuicc^ and {Performance* Supported Wbrk jobs 

requ^Xf, iw; Bli^ relatively low wages. However, is 

;4m.6ppo^ for indiyidv^ increase their program earnings \ 
through bonuses good, performance: and regular attendance> 

Participation in such a program may mitigate a number of the 
factors ttought tuD be relate^ to the unusually high unesployment asoiong 
this segment of the'^uthif^ F4xst, it^provides ^.opportunity 

for partici Second, it permits^^them ^« 



to btu^ld 1^ a work history whidi thpuld ijsprove employers' willingness 

I" ' 

y to hire them; Thirdr in 'sonUt instiuiceSf these-y.outhlwilL~acauira ^ 



-specif icr^fk^sk^^ job experiencf . Fourth, Supported 

fforic incliides jol^feadUjtiMs^ ^1^^ job-placement conqppnents Resigned 

to facilitate >4^e transition to regular employment* Other important 



Hartfor^, Jersey Cit^, 

Halsachuset^ New York City^ Phil^elpid West Virginia (five counties 
iA:^1^-no]^^ region! of. ttoi st^tui) r ud Foh->du and, Wiimebago counties, 
|fi4c^^ '}¥i6t%\ recently, Stiqpport^ in JBergeh^ Counter, Atlantic 

Coiyi^y>^^^ Trentpn, (N«^^^ and ttvi fMstem^ 



PRir / 



pairyland ^liegioh 



cphsin iluve M youth. 



a; - . ^ 



' ' 'tis? 



:>G'riteria 



Restrieti e n^ 



Employmj^nt Histpiy 



.Schoor status 



17 to 20 years old 



Ciu^ently unenpibyedj ho TOre^-^ a tot^i;* of - 
40 ihouM wpriced: dvuring f^V^ weekS; 



No nore thw; three months in: ohie regular 
j'lob (^^ 20 or more hp^^^^^ par *reek)^ 

jeii^ last six i^nths: . ^ " 1 

No: previous p^^^ either > 

;S\4^^^^ .the^evaluatibn — ~- 

' cimtrpl group 



{ 



>No high-*school or high^schpol equivalency 
diploma . ^ 

No enrollment in^ school during last 
months y - . * • 



jHistory-of-Contact-with*-- 
* Law Eniforciement Agency 



-A"recprd~of^delinquency (for at least 
50 percent of the youth enrolled) 



SOURCE : 'Summary: of the Second Annual Reipiort^on^thejJIational^upported 
" Work Demonstration . >Nw York: Maigower Demonstration Re&earch 
^Corporation, 1978* ' ^ 

V. ^ . ; \ ^ . ' ' 

NOTE: At the pr6gi*wAs; disc youth may be termed ^ineligible if 

they Uve :in a res^ were /referred by a source that 

required them to be eiqployed. ' 



: - 35 --. 




- ^ _ ^ _ . ^ . ;be. reduced Welfare 



?>v ' .iCjPpMecpi^^ the Supported Work expef ience jnay : 
> ^ Xej^<le^^ in crime,, ^md. lover ratei of drug, use 

l\- * ^ thah'woiad. Otherwise be expected<»^ Progran effects in the last two 

/ - " To*d4^e^i the / only yputArpriiat*^ .prograxsf for yhich there is. 

convinqina ey^d^^ of favorable post-program iinpacts is Job Corps. / 

which is dULstdLhgu^ from the variety of otdier programs noted in 
. its residential cha£l^c^^ex;;^ its inbre' coiqprehehsive provision of education, 

I. .-^ tan4ning,^ Ma •inploy5»nt>jq?«ri«nce,. and its client population (which 

t«hdi^,;,b« mor« '4isadv«rit;4g^d) .-' Insofar as Supportad "Work serves 

a simil«ly^ disa^^ 



stjpportive^lTeat'ureS'J^^^ to work e)(perience, there is some 



/ reason toUxpect that it may improve this enqployment situation of par- 
ticlpatihg youth'. , However, in its enqphasis on work experience. Supported 
Work is more similar to«\jt:he variety of programs for \iAiich there is more 
limited evidence of favorable post-program iapacts. ^ 



E. ORGANIZATION OF THE REPORT 



, J?hie^report^estimates .the economic and-social consequences' for ' 
youth participating in five iSupported work progr^. In addition- to 
considering overall ixiqpacts, it addresses the issue of whether the program 
laight he more efficient if targeted toward another group or subgroup 
of youth or whether such a program .should be implemented under only 



^ About 87 percent of Job Corps eni-bllees have not completed high 
scho9l, 70 percent are from minority ethnic groups, 33 per^cent ate from fami- 
lies receiving public Mfistance, a^d 30 percent of the^^les have been con«< 
i^ictod of a criminal offense, {U.S. Department of liabor, February i979^)> 



^Ka: he3^ chapter pr^ *back'gTOurx(l: infprxnatipn 

aJx)ut ^^a/iai^ baijag st^^ dlscnissas issaes 



raiatad to tha reaaai^ :KypotiiM analytic techniques 



aii|>r6yad* ii; tha avalua^ Chapter 311 diabtui saa aii?>l6yxnent-related; 



t 



dhap^ar^ ly through; V^^^ prasant findings, related raspactivaly / to 
/inc6»i iourcas arid ijfirki^id tri^ drug usa> and ijawlvaroht in 



i 



4. 



1^ 



^ Three cos^axiiph report^ prajant the results of evaluation of 
supported Work's effects: for long-tf.erm recipients of AFDC/ ex*^addict8| and 
ex-offenders. Another report pres^ti^ a^ full l^nef it-cost ahalysis. 
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selected control groM^« While, not without risk and lin^tations, an 
^•n^riinantai Resign wu^ adopted for the natdpnaLl Supported jAbrk 

' ■ ■ ' . / • • • -v' • ,u ; V 

.d«»onstratiioh^ -naldiitj It poss for resejurchers. tp-^estiaate with 
a k^oim degree^of atatist^^^ confidence the impact ol5 the Supported 
Work program,' - * . ' " " • 

!• Sample £nr611aent and Data Collection ^ < 

Jlppriciuits for you^ slcta in five, of the " 

deacMtratipn sUtes-^rA^ Jersey City, New York, apd - 

-^Philadelphia^-^were Randomly assigned ^o either an ex^rlnental or a 

control, group Members of the exjperimental group werje offered a 

Supported Work job for up to 12 or 18 months^, depending pn the site; 

members of the control group were not. The first youth siibjected to 

random assignment applieid to. the Jersey Ci^y program in April 1975, 

* • 

Random assignment than continued through July 1977, by Wii6h time '570 
youtl\"ha<\ been* enrolled in the e^^rimental group and 682 assigned to 
•the control ^roup.-^ Table II. 1' indicates the enrollment in the youth 
saxqp^le over time in each site. > 



•i' In all sites except ..jirtford, 50 percent of ;the applica^xts 
^were assigned to- the ex^rimental grovip. and 50. percent jto the control 
gioup. in qrdisr to ihcieMe; .the research sanple beyond that which 
would be geiiejeated by |^ 5br5P ^^assignment given funded program s\ots, 
4p^ perccfnt of ,the Hartford applicants were assi^ed to : the expefi- 
mental grotq? and 6tf percent were assigned to ^ the control group. 
•Jackson et al. (1979) describe the random-assignment process in 
detail.' - ' . 

^ In general/ random assignment resulted ^ji a. sample of 
experimentals and control^ with similar c'haracteristicsj {see Table ^ 
A.IK, ^However,, statistically significant- differences An age and in 
. crindnkl'jiis€ories .were observed; thus highlighting the importance in 
.the intact analysis of s^tatistically cpntrpliing for such differences. 



v^-: -, 



-W^ -e^'. 



•7 



ompxiifiirrAjr am^A^ 



toon siHns^ 



tnrollJMint Nribd Atlanta Hartford - JtrttV City liw Tork FhiUdtlphit Miw^r Perctnt 



/Stcood Cuu:t«r 
TlUrdltutrttr 
•rourth:8uart«r' 



Tirit Qiiirttr 
s#coQd;Qtnrttr . 
^ ^ Third Qumtr 
Fourtb QuArttr*' 

1977 

. ririt Qutrttr , 
Stccmd Quarttr-' 



22 



46, 
38 



«^ 31 
,$7 • 
109 
114' 



146 

129 



14 

23 . 
44- > 



10 
24 

25 * 

52 . 



29. 



43 



86 
48 



. 34 

» 7 



16 
,9 
2? 
5 



14' 
57 
71 



. 57 
*i 122 
156 
236 



316 
215 



1;X 
4.6 
5.7 



4.6 
9.8 
12.5 
19.0 



25.4 
17.3' 















Sitt'totaX 


106 616 


* 243 


^ 179 


100 


' 1,244' 


>^ 








?tretnt of Ovtrall 


''a 


• * 








Total 


8.5 49.5 


19,5 


' ^ 14.4 


8.0* ' • 


* V . 100.0 




■ - , ^ r , ' , ' 1 











NOTE: Thtse figurtt irt only for youth 'wbo, cpapltttd an tnrollMnt (battlint) inttnriev. 
includes all but 8 of thost r*i^jeettd*to randoa assiguMnt.' 



This 



Thtft fi^urtJbii^^ 4b July wtfo^Ui^Sta . " ' 



J . 



2,^ 



> % 25 



r. 



^XllMiiifnbttrs'o^^^^^ groups; were 

schedu^d it^^ Imt inte^naewed;^)^^^ (MPR) staff 

at thfj tij^ of their jgpplicetibn^ to deterndne ;their ^ :f: 

dimqgraphic charaot^rlstlcsV their enployi^t M depi&ndence, 
drug \ise# end criminal justice eiqpefiences. -They were then sdieduled . ^ -^f 

to be reiixter^iewed 9 to coHect po8t«*enrollinent^ ^^.^ 



Host intejcviews were f ace-to^^f ace and conducted either in MPR 
site offices (62 percent), or in the field (24 percent)* However, a few 
were conducted in prie&ns and ovex- the telephone, in which case questions 
aboutt criminal activities and current drug use %rere not asked* For more 
detail on interviewing, procedurei and xesults, see Jackson et al. (1979) • 

2/ * ^ ' * 

^ ' This sauqpling strategy was underteUcen to maximize statistical 

^ . power of the analysis, within a fixed budget (see Ruth et 1980, ox^ < , 

MDRC, J.980, for further discussion of the sample design). j 

^ Si^parate^ samples for the 1-^to 9- and 10- to 18-month periodsj 
%fOuld have been slightly larger than that used. However, offsetting the, 
/ \ wdvantages of larger samples were added' comp:).ications of comparing 

results acrois tijoe for somewhat different samples and higher computation 
costs. \ ' ' ' * 



dat^ oh it^^ drug -use, ahdj ^ / ^ ^ 

cr^^idnal Bec^^ 

1979, .only 57 percent of the^'taiqple (those enrolled Jprior to ' ! 

1977) were schedtiled to -be^ iiiterviev/ed again 27 months after their 

" • ^ ' ^ ; ^ . - . . • . I 

'enrollment, and 1& j^rcent (those enrolled prior to i^ril 1976) were j 

' ' ' ; . / ^ V 1 1/ 

scheduled to be interviewed both 27 and 36 months after their enrollment .r/ 

Because of the differential length of foll6w-;\q> among san^rle ; 
members, an^ysis of impacts for the various post^program periods' 
have been based on different subgjfoups of enrollees:^ • analysis of 

outcomes, during the first 18 months following enrollment have been based 

»* " • ' 

^ * 3/ 

on those who completed an enrollment, a 9-*month and a:i 18*month interview;-^ 



^analysis of impacts for the la-r to '27-m6nth'jperiod is based on data for 
tiiose who, cori4>let^^^ an^entol3jD«ht^^^^^ a 27-month interview ^ 

regardless oi whether or not they, completed thte assigned 9- and 18- 
month interviews? and the analysisrof-28- to 36-month outcomes relies 
on. data for those who completed an enrollment an^ a 36-month interview.*-^ 
While interview response rates were higher than initially anticipated, 
between 20 and 30 f^krcent of those scheduled to receive the various • 



follow-up interviews failed to conqplete them, thus resiilting in the 

• ' ' 2/ 

analysis sample sizes reported Jji Table II.2.-' 

~ ' • ' » 

An ii^ftant implication of the sample design is that the 
seniles for analysis of various -pbst-enrollinent<? periods are distingxiished 
from one another by the date an individual enrolled in the program: 
only the earliest enrollees received t;he longer-term fnllow-x^) interviews. 
ThuSf to the extent that the individuals' characteristics / -local 
labor-iuurket conditions , and program characteristics varied across 
these enrollment periods, the estimate.^ of longer-term refsults based 
on fhese particular subsai^les may not be representative of those that 



^ Analysis samples for the 19- to 27- and 28- to 36-month outcome 
measures t^ere defined' in this, manner in order, to maximize the nuaaber of 
udable observations,, as sample "sizes for the later follow-up periods 
were marginal* Analysis of selected outcome measures (fo2: example, some 
crime' recidivism measures} do require that sample member* will have 
con^leted all scheduled ;lntervi«ws. Theue deviations ^in the sample 
definition aire noted %Aere they occur, 

y Ta)5le A. 3 presents data on the number of various types of 
interviews that were assigned and conpleted. Brown (1979) ^% conducted 
an anad-ysia of the inqpact of ^interview nonresponse on- the evaluation 
results presented in this report, and concludes that the con^arisohs 
based on tHe coa5>leted interviews generally yield unbiased estimates of 
the true effect* for the f ull . saaqple of youth enrolled in the research 
sasqple (see Appendix B}* 
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_ IS ""l 








>/iteiitfei'.li)><>?" 2^ Z'. 


-;Months 128; 36 J ^ . : 








Perceht=f:. 


, Number: 


Percenti^- 


.site-. 




< 






• 




Atlanta ? 


. 83 


9.6 








0.0 




•38.4 


44.6; 


232 


45'. 2. ^ ' 


' .20 


13.1 


Jersey -city . 


192 


22V3 . 


ijo\ 


33.1 


85 


55.6 - - 


, New York/ ^ 


- 135, 








U 


u • u > 


Philadi^lphia 


■67 

> 






IS.2 


^48 


31.4 


:Lite*t :Folloi^ue 
Interview^/ 












7 




• 












is w 


442- 


■,'31-.2 , 


n.a. 


n.a. 


n.a- 


n.a. 


iT' abriths. , 


298. 


34.6 


368 


71.7 


n-,a. 




36».aotiths 


121 


14.1 


145 


' 28.3 


153 


100.0 


Total 


• 861 


ioo.o 


513 


100. 0^ 


153 


100.0 



v-^"*<l* 



NOTE: Actual saxqple'sizef vaxi^ s^Mwhat by outcome measure (see; Appendix • 
A.^)/ but>g;bneraJ^ iiu:lvded 90 to 99 percent p£ the, cases in tljese > 
totals. Most b£: thm evaluation results ^e ^'asmd ok multivariate 
analysis that controls for preexurollne^t characteristics of experi- 
mental and cbntrpi groiqp. muftN^ T^refore, all imalvsis sasqples 
include only indllddiia^ (baseline) 
interview. Analysis of o^comi^ during the first 18 months after 
enrollment has been bwed dnly/^ who/ in addition to 

the enrollment interview^ . coipl^ted both the 9r and IS-^month f ollow«> 
Tflp interviews (refewe^ to 18-m6nth .analysis senile). Q 

Analysis of putrami dii^ 19^27 and months 28r36 are based 

on individuals irtip^^ c^ and 3(5-TOhth iiiter^ 

respectively^ regard follow-up interviews- they 

- con^leted. They' are ref e«ed/tb hereafter as the 27-month analysis 
sanpie and' the 36r8bhth ak^ saaqple.' 

a/ ^ - ' ^ - ^ " . • ^ 

^ These are percentages of the total youth sample in the appropriate 

reference period. 



few 



These figures refer to' the latest coagleted interview. A 
sanqple members were -scheduled to receive stdbsequent interviews but ^ 
failed to complete them. Also, recall that some individuals in the samples 
for analysis of; 19- to 27- and 28- to 36-month outcomes did not complete 
a previously scheduled follow-up interview. Thus, row totals veury, 

« ' . * 

' n.a. maans not applicable*';: - 



^actuaiij^ pc the fut^^ of this factr care, heis " 

been tjiken subsec^uently to assess, tiie extent to which the subsamples- 
fbliowea./ior varying, .jgerioas of ti^e .diff^^^^ in either their pre-enrollment 
characteristics or in their i?pst>ehrpl2^ behavior* \ ■ 

Another 'concern with the de^xxstration data is the quality of ^ 
inforxnatioh obtajjied thr £ace**to-^fac6; interviews. As psurt of the l'}. 
evaluation ^fprt, con^arisons were made between interyiew and official^ 
records 'data on earnings, , we jEfaure. red and' arrests. The general 
concltisipn from these conpaucisons is. Jkhat the quality of the interview 
data is G[uite -good. Specific quailificatipns of the findings that are 
warranted, based on the results of these validation efforts, auro noted 
,and justified in the subsequent chapters. . ' 

2. Characteristics of the Supported Work Youth Sample 

As. seen from the da^a in Tad^le II. 3, the characteristics of the 
youth sanple eure similar to those specified in the eligibility criteria 
'(see Table I.l in Chapter I). About 60 percent were younger^ than 19', 
over one-third had completed fewer than 10 years of school, over one- 
fifth had never held a regular job, and of those who had held such a 
job, they had not had one for an average of nearly 11 months'. In 
addition, 57 percent reported haying been arrested and 38 percent re- 
ported a conviction. 

These^ youth also exhibited other characteristics which identify 
them as being among those who aure particularly likely to have limited 

employment opportunities. Probably the most noteworthy of these pertains • 

> 

to race;y^ver 90 percent of the sample were from minority ethnic groups, 
among whom the national unemployment rate is about double the overall- 
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43 ;6 


;5ip:7 * 


' 5i9 






:i8-^- 

72.6 ? 


.15; 6 ^ . 
5;9'^ 

' 78.5 


14.6 
9.4\ . 

76;0 


12.1 . 

,7-.l 

80.9. 
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1S.4 


15.1 - 


« 16.4 


18:3 






23;7 


24;3 


22.6 


22 . 9 , 






3S.2 


35.4 


34.7 


^ 40.1 




XX err »ore 


25.6 


25.2 


•26.3 


28.8 


{ ^ / 


school, eoi^Xi^id) 


(9.6) 


(9.7) 


:. (9.6) 


(9.7) 


Y«*ri SiSciriiir^- — 
EnrbXXtd in School 








, « ♦ 








36.2 


. 34.0 


4P.7 - 




1-2 


26.4 


26.8 


30.2 


24.3 




Moro. than 2 


39.0 


37. w 


a 


3S 0 




ktaton Lift School 




1 
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Ixptlitd 


15.2 


^ 15.2 * 


i 15.8 




- Dropped > Out 












Want to. jail or in> 
troubXa With-polica 
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Wantad a job 


28.2 
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4>idn* t liSca school 


11.1 
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\ Othar 
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Undaivant Job Training \ 
in>aitVaar 
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14.1 
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tivtd in public housing 
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14^ 


12.0 
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(Avtragt numbtr )f 
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(37.2) 


(35.1) 


• 

(32.4) 


Cvtr ustd any drug 
othtr than marijuana 
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29.6 ^ 


41.1 


Evtr ustd htroin 
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. / 16.3 
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3;2 . . 
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4.4'^ 


5^4 . 


5.11 


13.0 


24.4 






49.3 


24.6 


27.4 


.24.1 
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5.0 


4.4, 
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NOrt: ,oth«xvis«/in^eAt«d, til data rafar to tha full aaa«iU (i.a.# aaro valtiaa 

> am inoludad). Pagaathaaaa ara uaad to-indicata Valw that ara not parcan uaaa; 

- - -Thaairdttr:irci:«<*r^ 



Ottly tw6 taa^la iMAbara ara fro« ''othar'* athaie ^roupa. 



^ Mtlfajra.iaoiuaaa Aroc/ Ganaral Asalstaaca« Supplwaantal Saeurity XAcoaM# othar 
valfara* and val fart lacoaM for which ratpondantt vara unabla^ to idantify tha aourca. 

^ thia^ infomation waa otottintd froi^ tho firat follow«up intarviaw but raftra to 
tha tima of anrollaant. ^'l ' 



' ^ Thia ineludta only thoaa who uaad dru9a a f av tiMa a aonth or aora of taa« 
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^ AVfr«^«l for youth* In additiohir tii6«t^rdf^^ V^^g p«6pl« had 

»-»' — ' ^ ' ' - ^ ^ 

btfM out : of school fo^ •hroiitd In th« . 

- program^ and 2^^^^^ thm ri^irtj^^^^^l^ 

laft school: bacausa of problaias ^dth^ tha polica. FaW.of thasa :youth 
vara. fluu:riad\and supporting^ d^ nvarly tWo«-thlrds 

' . vara livijfig. with ktl^^^ i^r notad pravlouily, thasa lattar 

' rc liar ac tarlstlcs ara o f tacna(a^^ with ralatiyaly low lavals of 

.attacfanaht to,f^^ : — ^ — ~ , ^ ^, ' 

V' / Thasa . charactaristics dM only a group of youth who 

hava sarious laix>r«markat disadvantagas in ralationship to tha ganeral 
population of youi^ paopla# but also a mora disadvantaga.d group {/ 
"*^than^tha typical youth anrollad in CBTA . programs,, which are also 
targatad' primarily at disadvantagad groups.. For axasqpla, a xmch higher 
proportfbn of tha Supported Work sample are mambers of black and other 
minority ethnic groups (91 versus 52 percent for CETA) ; virtually ,none 
of €he Supported Work aasqpla as compared with 67 percent of CETA enrollees 
.had conqpleted high school; furthermore, the Supported* Work sample consists 
of school dropouts, while' a sisable portion of the CETA participants 
are^till enrolled in school; finally, only 2 percent df^^TA youth 

are reported to have a criminal record as* coniparad with 57 percent of 

'1/ ' 
, the Supported Work sas^la**-^' Th? i]iq;>loyment intact of the relatively 

more disadvantagad status of the Supported Work sample as compared with 



^ Tha CETA data ^•'•^•nced here aire from WESTAT (1979), 
Tables. 4-^4 and $-2, ;t should ba*^ noted . that increasing empHasis has 
recently been placed on targeting OBTA .funds toward the most severely 
diiladvf^taged. As a res\ilt of this change in focus, the characteristics 
of CETA youth way become more like: the Supported Work, target group in the 
future: (see U.s/ Department of Labor, 1979). 



'tiii typical dSTA tnrolUo ik •vidMctd by th« faot that th«y 
M^ldyad only 19 parcant ,6£ tKa yaar prior to anrblllng in tha 
daMnatratiorir vhila YEDVh youth (whbsa charactaristics %ra similar, to 

all yoiiUi ClffA participw^ wara aaployad during 37 parcaftt of tita 

* . ' t 

naaka that thay wara hot anrollad in school (WBSTAT/ 1979) « 

Tha Suppo:i^ad Work sanpla, than^ is~^rtaiivlyHiTil^up-of you^ 
irtio ara not axpactad toconpata succasstully In tha raoular labor markat 
%rithottt sons spacial assistanca« In tha naxt sactiorir wa dascrlb^tha 
natura of tha aiqparianca and aaploymant assistahca providad to thasc 
youth through Svvportad Mork -progrsns* 

B« THI SUPPOBTEO WORK PROGRAMS-^ 

Stspportad Wbrk Icrdafinad as a structuxredf transitional asqploytoant 
axparianca' dasignad to halp thosa with wall-astsblished aiqploynant 
diffioultias gain tha s^arianca and dovalop tka work habits nacassary 
for succassful participation in tha workforca« Tha thraa faaturas of 
'Supportad work which, in combination, distinguish 1 : from othsr amploymant 
and training programs ara as follows s 

a Paar group support 
. a Graduatad strass 
a Closa suparvision . 4. ^ 

Whiia tha damonstration plannars^^and tha program oparators shara tha ^ 
basic conviction that thaia alamants ara critical to tha succl^ssful 



' ^ For a mora datailad dascription of tha Suipported Work programs, 
aaa KDRC (1978) or MDRC (1980) « 
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prapjuratibn of St^ppoct*^ for transitibh into 

univJ)«idix«d..«Bp.loy««nti. th«r«; i:«; no ,coM«A»M.M..tq the roost affective , 
strategy for. thfir iniplMMntation. Partly as a result 'of philosophical 
dif ferMoes aaon? progrin partly due to local job develop- 

iMnt opportunltvLtts constraints ^ thsre Is consldtrable variation in 
thi^ iiq^iiBi^ kay programatic coaqponants. Tablfu XI«4 suomarizas 

soM o£ tha kay faaturas of tha fiva Supportad Work programs from which 
tha youth saaipla. was drawn* 

» 

!• ' Canaral Chiuracte rv dstici. 

In dueigning th.^ national Siyportad Work dar^nstrationr a numbar 
of progran charactaristics wara standardised and tha variation in others 
wasdimitad, in -yzdir to assura tha *iii5)lamantation of tha Supported .Work 
modal « The madn aix'lrrity anwag the five j>rograms in which the youth 
exparimantal group wara offered as^loy^f;?nt is that they are aUl primarily 

work-axparianca pVograms, offering limited- tana empioymont at relatively 

1/ 

low wage rates to groups of disadvantaged workers-, -^ All programs 
impiamant tha concepts of close supervision graduated stress, and peer- 
group si:?>port,'and none provides significant amoiiits of ancillary services. 
Thevsise of the programs, the target groups- they st:.-v«, their job mix, 
and their iroplemitntation of the special Supported. Work f«atares vary 
considerably, however. 



^ On average, those youth who were employed during the year 
prior to ,their enrollment, in Su5>pprt9d work earned an hourly wage of 
$2.68, which is between 0 and 17 percent higher than the starting 
program wages. This is consistent with, bhe demonstration's goals 
of setting prograni wages slightly below market opportunity wages for 
target-group miwnbers. 
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. Th« AtlimtuK li^^^ 

j^eint. dfVth* .yotttt/^ wcr* cbh- idtriblsf «iiiUr and^hid 

.substantially Isss ssqpaMlon of ^^^p^ slots duxring^ ths psriod undsr 
, st^y than tha othar thraa sitas. By Juna 1977^ thasa ^tud p^^raas 



avaragad only 90 to 100 total 'joS alots/ whlla tha othar prograas aach 
had:batWaah. ZOO and 300 slots. ' ^ :\ 

;Mona of 'tl^sa iprograiM saryi^ youth axclusivaly* Thn Atlanta 
'md^Naw yprk; pip^^ of thair ' job. slots (61 and . 

*74 parcantr raapacU.vaiy) With AFOC M'owmn. Jarsay City dayotiid 80 / 
parcant of its"^ slots to ax<^ff^darsoax-addicts^fand ax-*alc6holica#/^< 



and Philadalphia fillad 89 jparcant of its jobs ^th ax-addlcta.and ^r, 
ax-offandbrs. Only in tha Hartford program vara ^outh tha pradoninant' 



targat qroxxg during this tim pariod (4T ^rcant of tha Hartford jobs 
wara.hald by AFDC Womaii'and ax-offandars).. 

K larga shara pf tfiie youths' an^ploymant in thasa f^va sitas 



cosq;>risad joba in tha 6ttrvicas industry«^pri3narily rapalr (including . 
auto rapair in Atlanta and Hartford) , building. naintananca# anjd ' 
misoallanaous businass sarvicM. Such jobs t^a particularly prafj^Lant 
anong th« Atlanta and llaw,Yor.5c progrM»» which, larvid only AFDC *55»«n. ' 
in addition- to ybuth^ Both the Jaraay' City and Philadalphi/ Jpyograaui • --m^ 
•nployad a considarabla portion of thair youth in conatrudtiqn j^a/ 
■uch lai painting, building rahabilitation, and claaning a^^^alin^^ 
unoccupiad houaing. ' Tha Hartford program of farad tlxa ip:im^ yariaty 
of joba, with about ha^f of thair wo.^arav baing anployadv/^dia J»«vic« 
induatry, but yith aizaibla nundDara working in parka m#ira^anca, building 




cbhatructioh and rahabilitatio.n,,and futnitura man\tfadMj^Fi«g and rapaic.^ 



V? 



• 2V The ptbieaentation offKey. Featured of Supported Work . 

'The manner in which these^ five programs have inplenented the 
• » « - * * * 

cohciipts of serr->group support was. much more consistent .across sites 

, than their ijpleiMita and close, slfpervision. 

?eer-9rpup s\qpport is designed to permit targets-group members 

to iiq^rove their ^ork habits and skills in an environment where they 

have the support of others who have similar disadvantages and anxieties 

aboutf their jobs. \ This concept has been ixoplemented in all sites through 

a commitment to crew work— grotips of Supported Worker^i (not necessarily 

from a single 'target 'group} working together. However, the average 

crew size varied from 3.1. in Atlanta (where 13 percent o£ the workers, 

mainly AFDC women, were not assigned^ to crew work) tc^ 7,4 in Karlzford 

<» ' . 

1/ 

(whore 22 percent of the crews included more than 10 persons)**-' 
Fxirthermore, the stability of crews vetried among sites, pairticularly . 
in 'respqnse to the^ length of work contracts: in sites such as thila- 
•delphia, which tended to rely on 'short-term work contracts, Orews were 
frequently dismantled and workers !k:eassigned to other crews. - 
^ The concept ^f graduated stress is , predicated on* the Belief 

that th^ tatrget-group members served by Supported Work could not at 
the time of their enrollment meet the performamce standards of the 
regular ledger market)' -^hat they needed an opportunity , to -gradually ' 
increase their skills and. is^roye their work habits. Thus, an important 
goal of the Supported W6rk programs was to develop jobs whereby initial 



^ The consensus among<program operators is that the optimal 
crew size is between 4 and. 7 p^xSgons (MDRC* 19%) , although evidence 
from a statistical process'^ analysis does not^ support this belief 
(Hdllister et ill., 1979)* 
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parfdxitfA pn the iAdlviduads were nbdest^ >ut idiere ^they 

::eoul4 1^ lncMM>i^^ J^m mti^ they resenbled. those the 

' participant could Mpect to face in nojt^rogram ^lobsf • 

One of llhe jaiaiin*appTOaci^ to iaplementlhg graduated stress 



thas.been thixiugh pri^ering the job taslcs sequentially—that iS, by moving 
workers into successively xabre demanding work assignments. Another 
^ luts involved the Tue of ''pej^ ratings such*as tho^ used 'in 

prbmptipn and bonus-award- decision^/ The Jersey City program, in 
particular, makes use oi the jol>-staging apprpach;«the Hartford program 
places 'considerable emphasis on supervisor Evaluations of a worker^ s 

performance in the.detennination of promotions « All programs have 

' A , ' ' . ' . • * 

used inactivations/ to some extent/ as a means of permitting participants 

to attend to personal problems, such as those related ^ to health, dirug 

and. alcohol abuse, and^ arrests and convictions.^ Finally, 6oth the 

Heurtford and Jersey City- pro-ams have transition bonus policies, 

whereby individuals who are successful (either on their own or %dth the 

program's assistance^ in findiiig a nonprogram job'v^ch they hold for 

a specified petiod of time -(Sp'^ays in Hartford and 60 days^in Jersey 

City) receive a bonus, the size of which varies with the length of'tiJDcr^ 

V • ^ , , • 

the individual has spent ixi Siqpported Work. 



The third i^ture of Supported Work is close^pervision.. 
This supervision is, desired primarily' to transt^ and develop technical, 
skills and positive work habits and attitudes. To a lesse^r eactent 



^ Programs may, under the dempnstratiQh*s guidelines, permit 
participants up to three months of inactive time in addit>ion to th.eir 
ffn ^v^n^imi bf 12 or ^18 monthrf^of active participatrion in Supported Work. 



supervisors are also^.expected to:provide personal and job counselling 

to participants* In all but Atlantar nvost workers are supervised by 

Supfjorted Work program staff who have, been hired leurgely because of their 

1/ 

technical expertise and teaching skills,-^ Among^the Atlanta work 

> * ' ' * -"^^^ 

projects,; a high* percentage of the paurticipants worked in jobs not under 

- * •*■ « ' ' '* 

Jbhe direct supervision of the Supported Work program and/ thus, were 
supervised primarily'' by the host ag^ency, with a Supported Work program 
supervisor meuntainxng- liaxson with the nonprogram supervisor. While 
more compatible with the job-development outcomes iri^Atlanta, where many * 
pjrogram jobs were single placements in public agencies, this method of 
supervision generally was not expected to be as effective as direct 
supervision by the Supported Work programs themrelves, except under 
care^fully selected situations. / 

C . HYPOTHESES- CONCERNINp PROGRAi-l IMPACTS 

A number of primary hypotheses concerning peurticipant outcomes 
underiie the ba(6ic Sug>ported Work concept and ttie chosen taurget " 
populations. In addition, the theoretical and evaluative literature 
cited previously ^ugges^ts other hypotheses that pertain to potential 
program impacts arid to differential impacts among subgroups of the 
youth target population. The primary hypotheses can i^e stated briefly 
as follows : 



Both during and after peurticipation in Supported 
Work\ e^^erimentais 'will have more staible enqploy- 
ment/ work more hours , and earn more- than their control- 
up counterparts. ' ^ ^ 




1/ 

• — Some progrcuns which did not enroll youth sought supervisors 
who, in addition to technical', expertise, had experience working with the 
target-group members they Were to supervise (MDRC, 1978) • 
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' f l^qpfriAfU^^ %dil btt immm llk«iy than. controls to 
' £«celvtt putillc^usi biuittflts a^d; among those 

•xpiuiiitntals wlt^ TO benefits, the 

ayeragra bMefit level wlii £|e If'.ss than they Would have 
. received had they hot' participated in Supported Work. 

e Experiiaentals will be less likely than controls to 
use drugs. 

»• 

e Experiaentals will be less likely than controls to 

engage in criminal behavior. ^ 

In addition,. Supported Work could have a nundbex :>£ other 

isqportant effects, such as influencing participation .in education 

and training prograns, hoosehold xonqposi^on, and health**care utilization.^ 

The rationale for the eiqploymentrirelated hypotheses ha:8 been 

discussed previously in the context of the design and jgoals of the 

St^ported Work programs. The hypothesized reductions in dependence 

on public assistance are a corollary to the es^loyment hypotheses. 

Both sociologicail and econooio'^^eories of the causes of drug 

abuse suggest that an employment opportunity suc^ as that offered by 

Supported work may affect the prevalence of drug use. Sociological 

theories en5>hasize the in5>ortance of peer-group attitudes towaurd drug 

use versxis ot ler forms of behavior, such as working. Employment in 

Supported Wbrk may be expected to alter the peer-group environment in 

such a way as to decrease the relative desirability of drug use vis- 

a- vis other actit'ities, especially through the intensive and supportive 

supervision. Sconomic theories, in contrast, are concerned with the 

cost's and desirability of drug use as compared with edtemative forms 

of consumption and uses of time, and the hypothesized program impacts 

based on these theories are ambiguous. On the one hand, the Supported 

Work program tends to Increase the opportunity cost of engaging In 
f 
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^tlM**ijatftnsiva aqtivitltts such as drug use and/ therefore, it woixld 
be e^qgnected to reduce the prevalence of use,^ On the other hand, 
total income is ei^cted to increase ' aniong participants .in Supported 
Work, thereby permitting increased purchase of drugs by those who 
derive pleasure from thehi, 

.The hypotheses suggesting that successful integration of 
youth into the labpr force might be esqpected to reduce their likelihood 
of participating .in criminal activities are 'also based on both, m 
logical and economic: ttieories*^ Among the sociologica}. theories is 
one which Qlaims that illegal behavior results from the disparity 
between the goals established and valued by society (primarily materieil ^ 
or financial) and the means available to achieve these goals. Supported 
Wbrk may increase the legitimate means for achieving these goals, 
thereby reducing delinquency and criminatl behavior. A second jiodel 
combines a labeling perspective with self -concept theories. An individual 
may have previously experienced contacts with agents of social control 
who have applied to him or her the label of "criminal" or "delinquent," 
with the result that the individual's self-image will align itself to 
this public image and lead to deviant or criminal behavior. However, 
once one becomes enployed, his or her occupation often takes the role 
of "master status;" submerging these other roles. A third perspective 



^ Chien et al. (1964) indicate, however, that drug use may 
not be time-intensive in the sense that it reduces productive work 
titfl^, except in cases of novice tisers or extreme addictit^n. . 

^ See Piliavin and Gartner (1979) for a more detailed dis- 
cussion of these theories of criminal behavior and their relationship » 
to employment. ^ 
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<$i:^9[itt^^^^^ behayi^or TM]^^ from associa^pn with peers 

^Who-4i|^ acceeteble '1^^ Thus, Supported 

Vp^^ forms of enplojT^ will tend to reduce criminal behavior 

1^ incriaiihg. contacts and interactions iunong others ^o are no*t driented 
\tpwardrra/<Jelin(3^ or criminal lifer style. 

contrast to these sociological theories, the economic theories 
of crii&inal behavior are based on a rational^cholce model of human 
bel^yipr;: . According, to these theories, pa^rbicipation in illegal 
activitdes^results from the individual'^s ,^fubj active '^valuation of the 
costs (e.g«,,the probability of arrest,<^ conviction, and incarceration) 
and the gains (e.g., ' financial benefits) of crime as conqpared with the 

costs and rewards of alternative uses of time (e.g., leisure and 

' 1/ \ ' 

legitimate esployment) ^ Inqproving one's en^lpyment opportunities 

wolild tend to reduce the desirability of criminal activity relative 
to es^loyment by increasing the oppoirtunity costs of engaging in 
crime. . ' » " 

In addition to the primary hypotheses noted above. Supported 
Work may be expected to affect participants in a number of other 
isqpprtant ways. First, it may influence youth's decisions to partici- 
pate in education and tredning programs. On the one hand, experimehtatls, 
as compared with controls, might decide; to invest more heavily in ^ 
ecjucation and tradning, either during^ or subsequent to their partici-^ 
pat ion in Supported Work, to supplement their program work experience. 
On the other hand, by increasing enq;>loyment opportunities for experimentals. 



; ^ For exawple, see Ehrlich (1&73) , Sjoqulst (1973) , Reynolds 
(1971), ahd^Danzinger and Wheeler (1975). 



:Support€^^^^ may lead 'youtiw^$^^^ formal •ducatipn and 



'training jOian tKey bttierwise Would'ihiyti. 



o£...participants and forror^^^ fhi» could occtar>itte as ^ 

a result of incraased consun^tion of medical care (subsiditl^ hy eijplbyer 
insurance policies or not) or as a direct result of the more proiiuctive 
and stable liferstyles pf these indivi^^ as evidenced % 6^ang§8 
in household cbaqposition .and hous^^^ consumption, for exaniplev 

Any of the . above .^ro^r^ iiq?acts, but particularly the pxrimary 
ixnpacts/ may be eiqpected to vary with the nature of ari- individual's 
Supported, Work experience, with changes in local economic and labor- 
market conditions, and with the characteristics of the individual youth 
who participated in the program* Each of the five Supported Wbrk programs 
in this sample may have different impacts on participants as a result 

of variations *in the programs* characteristics, the labor market- in 

i ' 

wKLch the programs operated < or the characteristics of the youth they 

served. The analysis estimates the differential in?)acts both across ' 

• . ' ** ' ' 

sites and among individuals of different ages, sex, race/ethnicity, 

levels of educational attainment, welfare dependence, household com- " 
position and living arrangements, prior work and job-training experiences, 
prior drug-use histories, , and criminal histories. However, .since 
mbst of Lhe variations in local labor markets are across as opposed 
to within sites, only morfe casual inferences of the sensitivity of 
program impacts to local labor-market conditions can be^ supported by 
. the data. 

Results of the impacts of other employment and training programs 
for youth provide mixed evidence as to* whether the above hypothesized 

MC • • • 44 so 



Pljiaaiy,' Supported Work '1^^^^ .. • 



^ ;; ^ * :§ f f f ctf; o£^;s^^ ''work Actually be realized. These, other programs 

' hay«'Md::I ia.<k«epin^^ in the progrmn^r-the average' 



have been smalU, at best. 

' ♦'^ . '4 / ' ' • - ^ *' * , * ■ ' * 

•lt.;i«:pofiii^ Si^ppart:ed%o^^ cam .achieve more favorable ^results 

; ^^^^••X^f support, close supervision, 

. ir^4 9?*4)"^*rfd «tXM«,-Md:1^^ yoU^h^,who 
'my .hiiyr nost «ey4re However , ,the iiq^rtance 

; of-^ thesa igec^^^ qualitias. of 'Supported Work may-b^ psarticulatly 

sarlsitiya to the prayailing iabor-'m2u:ket conHitions during periods • 

^of relatively high unaoplo^ent rate's, the .effects . of factors such as 

employer preferences, for adult workers and limited job experience may ' 

be most severe and, thus, the work experience an^" credentials provided 

by Supported Work may be partiouleurly beneficial. Alternatively, it 

' may be that a much stronger treatment than Work experience* will be 

necessary" to substantially affect one's employability. during such times. 

> " • 

Because of our inability to directly estimate the importanje of local 

labor-market conditions on the program's impacts, we view it as 

essential to provide the reader with a general description of- the labor- 

market cohditions and alternative employment opportunities available 

> 

during the period of this 'study* 

D. LOCAL LABOR MARKET CONDITIONS 

Two factors related to the lodal iaibor-market cohditions that 
prevailed during the period vAien individuals participated in Supported 



^ See MDRC (1978) and Mallar et al. (1979) , respectively. 



Wbrk: and sub^^ jobs may be 

es^cted^to have; Ihfluehcid the effects of -Sti^fortedi Work. Thi first 
isVtii^trMpl^^ site to^site and 

:al8p : showed, i>prpye«ent oyer tine.-'. As, can 

,ba #een .ffo«*rigT« toneioployaeht rates during the 

detenstwation period Were highest in Jersey City (12.0 pe?^cent). and. - 
New- Yprl^ \(9. 3 percent) ,Md^ in Atlanta „(5i 8 percent) and Hartford 

(6.8 percent). While throughout .1975 and 1976 and in 1978 > the area 
uhonpioymint rk^s tiihd«d to fluctuate with little in th^i way of an 
ovarail trand# conditions did inprova sv^bstantially in 'all sites during 
the first three quarters of 1977, particularly in Hartfo^ and Jersey 
City, where the rates fell if rom about 9 to 5 percent and from about 15 
to 11 percent, respectively.-^ , " 

The second factor which may influence Supported ^^rk's iitq?act 
pertains to' the existence of alternative programs and services.' CETA- 
sponsored programs, have provided "the .^majority of the enploy»eii€ oppor- 
tunities for those youths upable to find unsubaidized employjnent. These 



^ Variation in market wage-rate could also influence the impact 
of Supported WbrJc. However, initfial vJariation in program wages relative 
to area reference wages were t^ot large, nor did they chaige-much 6ver 
time/ Controls' wage, rates during the first nine Bubhths following - 
enrollment in the deaonstratioh averaged between 10 (in Philadelphia) 
and 35 (in Atlanta and Hartford) percent higher than entry-level program 
wage rates, and there is no consistent pattern in these relative wage 
rates over tim^. 

^ AS can be seen in Figure I.l,..the youth unemployment- rate, 
while substantially higher than the overall rate, tends tp exhibit the 
same pattern of , fluctuations over 1?im«. Thus, we expect the inter-site 
conparison based-on overall rates to be indicative of the pattern that 
bhii. would observe among youth. 

• , • y 
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TRiSND III Al^ UNatPLOYMBNT WiTES DURING THE PERIOD OF THE SUPPORTED WORK OEMONSTRJITION 
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4-H — h— 



1977 



.1978 i^*75> 



SOURCE: Various issues of Employment and Earnings ^ Washington, D.C. t U.S. Department of Labor and 
NEWS, Washington, D.C*t U.S. Department of Labor 



'pxoqrsjw ••rv*^" about 1.6 nilUon youth, in fitcal y««r 1975, and by 
t^V »<«ra aarving 2.4 Million youth par yaa-: {aaa Tabla 11.5). 
NMt of thia incratta haa j^aaultad from w^anaion of axiating youth 
pro^aaa. and tha craation of nawxpnaa undar tha Youth Employnent 
Daiwhatratlofn Projacta Act (YEDPA)'. Howovar, thaaa naw program joba^ 
hava not baan diattibutad in proportion to eithar tha youth population 
or tha \mai*loyad youth in th-a vafioua aitea. Aa can b« aaen from Tabla 
,11.6, Naw York' 'and J>hiladalphi» l»»va axpariahcad tha amallaat incraaaa 
in youth awloymant opportunitias raiative to thair youth population, 
and Jamay City haa ajqpariancad tha graataat.^ Tha axpanaiona in 
Atlanta and Hartford ara alao moderataly high, especially in light o^ 
thair relatively low unea^loyment rates, fm a consequence of these 
pi-ograma, which warev aimed primarily at disadvantaged youth, employment 
opportunities for the Supported Vtork target population might be expected 
to be ralaiivaly more favorable in Jersey City, Atlanta, and Hartford 
than in tha other site^^ As previously noted, these differential 
opportunities could potentially influence the impact 'of Supported work. 

Other programs tiiat have differentially affected Supported 
Wo'rk participants in the various sites and thus warrant mention are the 



•i/ However, the unemployment rate in Jersey City was nearly 
twice the national average throughout most of the period under study. 

AS will be seen in the subsequent chapter, the controls in . 
Atlanta and Jersey City did tend to work more than average, particularly 
durSrtha later time periods when these CETA-fmded programs would have 
S^Ia operation. However, for most of the follow-up P«^i°d' J;^ 
no clear evidance that youths in these sites were especially likely to 
i>e aJVloyad in tha CETA programs* themselves. 

* 
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NfiMBIR OF PARTICIPANTS IN CETA 
; :YOUNGlR-THWi.22 

(Thc^ttiidt)! " 





... Title 




Fiscal Year 






1975 


1976. 


' 1977^ 


• 1978 




''Enpibytbility Development 


695 


982 


73i 


■ 650 


ii. 


PSS-Structurai-' ■ 




J 56 


^' 72 


»> 

44 


til. 


SuNier Youth^^ 
YEDPA-^ ■ 


716 
n.a. 


821 
n.a. 


907, 
n.a. 


994 

377 


pr. 


Job Corpi^' 

V 


, 51 


46 


66- • 


70 ' 




^ PSE^Countercyclical*^ 


34 


109 


120 


218- 


vVIII. 




n.at. 


n.a. 


'n.a. 


27 


TOTAL 




i,5f50 


2,014' 


1,897 


2,3*80 



^ Source is Table F-7 of the Employment and Training Report of 
the President. U.S. Department of Labor, Washington, D.C., 1976 through 1979, 

•b/ u ' " ' 

- These data are from En^jloyment and Training Adminintration, 
0*M TransiBittal Nuiaber- 9-79 ,. U.S. Department of Labor, Washington, D . C . , 
April 25, 1979. ^ They also incluie an estimated 30,000 participants in 
YIEPP . - F 

• c/ . ^ 

- ?i«cal year 1975 and 1976 estimates are based on data on number 
of .job Corpi: slots and iveragie length of stay in Job Corps presented in 
Job Corps in Brief. U.S. Department of Labor,' Washingtori, D.C., W78. That 
for 1978- ,i> based„on the facts that there were 35,000 slots in the third 
quarter of 197-7 ( Employment andnTrain^q. "Report of the President . U.S. 
D^part«?nt. o£ Labor, Washington; D.C.; 1979) , and that the. average length 

^<>I.P«rticipatipn IS about s.ix~m6nths (Millar et al., 1979); The figure 
for .f iscaa--year--1977;Jjr^^^ Chapter 3, TiBle 5 of 'the Employment and 
Training Re port of -the PresrdehtT -UrS .--Department of Labor , Washington, « 
D.C. , 1978; -—- ^ • 



- These data are from Employment and Training Administration, CAM 
Transmittal Number 9-79,-U.S. Department 6f Labor, Washington, D.C., 
April.^25, 1979. • ^ ' 
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n.a.» not applicable. 
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jaix»ivM: SLOTS- -iN:'if6ora 

:iMpa6\M»T 'pa^^ (Xccip) 



SuabT of :Progr««. Slot«-^ " . • At ;?trc.tnt*qt. , 
J«nU«ry- Spril- ~ . July- " . ' * ' .orArt^ Toiith , 



Atlanta 


317 


519 " 




1.423 


■''•2-1 ' 


Hartford 


0 


• 420 


393 


630 • 


* ; 2.9 


Jersey City • 


'1.224 


434 


89 • 


-1.857 


. 6.2 


New york 


• 0 


■ 1,648 ■ 


, 0 


1,903 


• 0.2 


Philadelphia 


543 


... 1,103 


940 


2.041 




Total UwS; 


116,536 


_ 172.047 - 


93.794 


289.211 

1 


1.1 

■ 



SOURCE: Youth Office, RAS pPRS Report 3. Pepartment .of Labor. . ' . 

>v'ashingtoft. D.C.. 1978,. \ . ^ 

NOTE: During Fiscal Year 1978. 93 percent of the enrollees in youth programs 
were enrolled in the Youth Employment arid Training Programs ' (YETP)or 
ihe Young Adult Conservation and Community Improvement Program VYCCIP) . 
. These ar^ the only programs for .which site-?pecific data were available. 

. ^ 'slots are estimated as participants "on board" at the end of the 
quarter. / ' ' ' " • ' 

- ^ Youth population estimates are based on 1970 Census data for th^ 
various cities, adjusted to reflect statewide trends in the youth population ^ 
between 1970, and 1977. . 



rphwployiMnt Coiiqp«nsation (UC) pxo9rans—>th« Stat* UneoployMnt Znsuranc* 

...[■■-. ■ . • • ■ . - . . . .j.^- 

Md SMqlal UniuqployiMtt Asaistahc* (SUX) progri^ias. Ourln? ihe initial 



1 



d«si9a jof th« Suppci%«d itorh danpnatiration, prbgiran enqployngint: waa 
l^ciflcfai;Ly. •xclxkted: f rem un0aplo]inMnt compensation cov<^raga iso that 
wi^isMCitMl% not face a strong viork disincentive as a' result 

of UC l^nefits upon tenaination from tihe pitograiu. ~ However, two .events 
altered thirinitial design. One was the' inclxxsion in the natiional 
demonstration of -the ongoing New? York' Supported Work program, i^cii, 

" • ' ' • i 

under state law, participated in the state OC^ program/ The ot^er was 
enactment of the SUA program in 1974 to provide uneaq?loyment compensation 

benefits to individuals who were esqployed in jobs not covered :by the 

i . ' # 

state UC program, but who otherwise met the state program* s eligibility , 

! ' '* / ' . 

criteria. The Stqpported Work programs varied in their response to 

this event. The Hartford and Philadelphia programs actively ^ttemoted 

to prevent their former participants from gaining eligibility ;f or SUA 

benefits, while a sizable percentage .of youth in Jersey City,.Jand to 

a X^sser extent in Atlanta, did receive benefits upon program 

• ' " 1/ ' ' 

termination.-^ Because the SUA program was lien^rary *(a>l claims 

were terminated on July 1, JL978)'and because a national Supported 

Work program would undoubtedly have a uniform policy viii-a-vis par^ 

ticip.^tion in state UC programs, the estimated impacts of Supported 

Work based on the current sample are not generalizable to future 

experience. The short*»term injects of the New York, ^Jersey City, and 

Atlanta programs are almost certadnly underestimates of the effects ' 



1/ • 

^ Receipt among the youth senile was not as prevalent as among 
the;AFDC and ex^addict sanqples, however. 



that would have bccxirrad in tha» abstnca of UC receipt. ^j{o%rever> the 
longer«-run ia^acts are less. ceriaim Dn the one hand, the availability 



of ,UC may promote longer average -periods of job search that lea^d to 
better, higher-paying jobs; on the' other hand, the job. skills and 
credentials gained throUgh Supported Work may decay ^during this extended 
period of job search. ^ .» ' * , '* • '^t 

Together, the variation across and within sites in unesqployn^nt 
rates, alternative youth e^loyment programs,' and UC receipt may ^ - 
influence the:, effectiveness bf Sugpported Work. Although no formal 
statistical evaluation of these 'potential ^influences is posTjiible, 
subseqi!4^ht discussions of findings ' (particularly with respect to site 
effects) do consider their relationship to prevailing labor-m2u:ket 
condj»tions« ... 

E. ANALYTIC APPROACH^ , 

• QMost of the , formal evaluation of Supported Work impact^ on 
participants has been conducted using mult^le regression analysis. 
Since random assigxunent to. the experixoental euid -control groups was 

sticictly adhered to,!/^ comparison of experimental and control group 

- , ■ • 3/ , 

means should provide unbiased 'estimates "of program effects.-^ 



Discv>6Sions of the vaurious analytic techniques, and statisticea 
tests des5criberl here can be found in Hanushek and Jackson (1977) and 
other econometric text books. . r 



y 

For evidence of the success of the- random *as5y^gnment proced»u:e 
see Jackson et al. (1978). ^ 

,By "unbiased^ we mean 'that', on average, the estimate neither 
overstates no*-; understates the true efffect.' * i ^ 
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Howttver, ifegression analysis has two advantages. First, to the extent 
, that measurable factors exogenous co the program treatment itself 

' if 

influence the outcome measures, regression analysis permits us to obtain 
estimates of program effects that have a higher degree cf precision 

- than those obtained through a^ simple comparison of mfeans approach.^ 
Second, regression analysis permits us to investigate easily whether 
program effects vary significantly among subgroups of the sample or 

• among yauth enrolled in different sites. - - ^ ■» 

The most. general model' to estimate overall program effects 
can be depicted as follows: 



Site 

Individual Characteristics 
at Enrollment 
demographics 
employment history » 
drug-use history 
criminal history 



^ Supported Work Status 
.{experimental or control) 



Program Outcome Measures 
Un-program and "Post-program) 
employment 

education and training 
income and in-kind assistamce 
drug use * • ^ 

criminal activities 
other 



Formally, the^ impact of program participation is -estimated through 
regression models of tlie form: 

Y = + a^X^ + a^X^ + . . . + a^x^^ + bs + u 

% 

I 

where Y is the observed outcome measure; X (m = 1, . . . , m) is a 

m 

set of variables indicating the Supported Work site and the characteristics 



^ The precision of the estimates is a measure of the likelihood 

that true program effects will not go undetected. 



of the individual; S is a binary variable indicating viiether the individual 
.was assigned to the experimental group; and u is a random error term* The 
symbol a^ measures the intact of on Y; and b is a measure of the overall 
in^ct of the program whose statistical significance level i& measured by a 
t«*test. (Appendix Table A* 4a identifies the control V2u:i^les used in the 
analysis and their means and standard deviations, and Table A* 4b presents 
estimated coefficients on these control variables from selected regression 
.equations used in the anzilysis.) 

The extension of this basic model to estimate effects for svibgroups 
pf the sample is quite stradght forward. The types of models estimated can 
be expressed formally as*^: 

+ • . . + b^SX + u 

where (k ^ 1, . . . , K) is a subset of X^. in this icodel, the program 

effect for a particular subgroup is measured by a linear combination of 

the b's; for ^example, if X is a set of binary vauriables to designate- all 

but one of tne Supported Work sites, then b^ is the program effect for the 

omitted site and b + b is the program effect at site k. The statistical 
•Ok 

significance of the various subgroup effects can be measured by an F-test, 

as cam tests of whether progreim effects vary eunong the subgroups (i.e., 

b » b^ « . . . « b. « 0).i/ 
12k 



In subsequent tables, statistical significance of experimental- 
control differences both for total . samples and for sample subgroups axe 
denoted by asterisks. Statistically significant differences in the 
magnitude of program impacts among subgroups (that is, whether the hypotheses 
that the program impacts arie similar for. all subgroups cam be rejected) 
are denoted by the pound symbol ( #) . 

f 
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We should point out that these .-simple^ linear regression models 
may not yield estimates of program effects with desirable statistical . 
properties in cases where the outcome measure is truncated (for exan^le, 
houjTS" worked) or in cases where it is dichotomotis (for example, 'en5)lbyed 
or not)*. Maximum likelihood techniques have, been developed to account 
for these properties of the outcome measures, but aze prohibitively^ 
costly for -routine use in a project the magnitude of this one. Thus,' 
since the standard regression td'chniques have repeatedly been shown to 
yield quite accurate ^'estimates in most applications, we have tended to 
rely on this procedure and to selectively reestimate a nuxnber c ; the 
results using the maximian likelihood techniques probit ^(for dichotbmous 
outcomes) and tobit (for bounded outcome measures) to test whether the 
basic conclusions are sensitive to this analytic constraint. It is ' " 
also important to note that the resxilts for some noncentral outcome 
measures eoce based on 3iJi?>le coii5)arisons of >TieaP' ,. since the cost i, 
of generating these estimates of prbgram impacts is subst2uitially lower 
that the cost of regression estimates, ykt, because' of the experimental 
design, they aure still unbiaised. We have jioted throughout the report 
both the results of maximum likelihood ""reestimates of the program • 
•impacts and those places where simple comparisons of means, have been 
used. 

Regardless of the analytic technique employed (linear regression* 
maximum likelihood, or compaurison of means) , the discussion iy." sub- 
sequent chapters focuses on experimentauL/eontrol- group differences in 
the various outcome measures. Since these differences are based on 
estimates of sample means, which eu:e subject -to sampling variability, 



^wt'jKust consider the likelihood. that the estimated difference between 
experimentals and controls is due to a true program effect as opposed 
to the random sanpling variability.— The statistical concepts which 

/relate to this likelihood are the confidence interval around and the 
statistical significance of the estimated differentials ^-i^ In this 

r 

report, we have adopted the standard procedures of indicating those 

i ' . '* 

•estimated program effects which are significemt at the 5 percent level ' 

. * * * 

''on a two-tailed test—vrtiich means that there is less than a 2.5 percent 
chance that there was no program effect given the estimated differential. 
We also designate estimates of program effects that are^ significant • 
at the 10 percent level, meeuiing tnat there^ is less than a 5 percent^ 
.chauice that the true effect is zero/ 

V. VRille we have adopted these standcurds* for denoting significant 
€(ffects" in this "report^ there are two counterbalancing considerations 

V^^ch we also consider in interpreting the results. The first is the 
small probability th3± a difference as large as that which is significant 
would have been, observed if < th'e^-true effect were in fact zero. This 

.means that one must e^^ect the occurrence of occasi6nal significant 



' The confidence interval, which is uniquely defined at 
veurious levels, (the most ^camon being the 95 percent level) , is the 
rauige of v2U.u?s which has a 95 percent probability of containing the 
true value. That is. If repeated samples were drawn, cmd estimates 
''and confidence interv2d.s constructed for each, 95 percent of these ^ 
intervals would contain the true value of the inqpact. If. both ends 
of the confidence interveLL aire greater or less than zero,' an experimental 
control differential is referred to as statistically significant (at • . 
the designated confidence level). For example, if we obseirve a 
differentiad whose 95 percent confidence intezrval is between $100 and 
$400 per month, there is only a .05 probability that the true differ- 
ential is less tnan $100 or greater than $400. 
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differehtia^^^^ eyeh in. the= a^ence;of r«ai/pi:o5^ The 
aecond^is that failxire to observe •i^ficant experjunental-control 
differences does * not necessaurily mean they do not exist* It 'may simply 
me^ ithere is so much S2unpling variability relative to -the true 'effect, 
that we cannot accurately estimate the 'ize of the true effects.-- 
In light of these considerations, in addition to adopting the standard 
ciriteria for-denoting statistical significance, -we have exercized 

some judgment in deciding which resuiljs or patterns of results are 

• — ' ^ » . • . 

particularly worth noting in the discussion and interpretation of 

the findings.-^ 



Increasing the sas^le siz^, of course,, reduces sampling 
vauriability and, consequently, the likelihood that such> true effects 
will go undetected. ' This concept of 1:he likelihood that true effects 
will, in fact, be recognized as such in the amalysis is commonly 
referred to as "statistical power," 

^ Y5t another consideration in interpreting thtf results is ' 
that, in som^ cashes, estimated program effects may meet the criteria 
of statistical significance but may be so small in magnitude that 
they are of lAttle policy relevance or, in other cases, r^^sults which 
do not meet siandaxd criteria of statistical significance may be 
so^iarge that a policymaker may want to act on the basis of the 
findings. 
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, . , ' *ih>'this 'Chapi^r^./'We^^^^^ to tha 

.suqceM of Stppprtad: %rk m a M^ms of Mtilgadiig It^e es^ probldms 
of ;::($Lskdw Aool <to 5b* oyarali 9onclw of the 

«tudy is ttot.^^^^^^ in impTOving enployrant 

PTOSMcts: ambng^ youth population, but i^ nay ba ona ' 

:of raducing youth jcMnjp ;by proylittng^ aiiielpy»nt for them in the 

isfcpArrtm ahv»> ti>e fqcw i» npt only 1» proatm the 

evidence on idiich these conclusions are based, but also Ito provida soine 
additional insight into thei nature 3md the causes of and potential fcures 
for the extraordinarily hic^ unemployment rates among this segmant of the 
youth 'populatioh* ^ ' 

We begin by describing, briefly, the enploytnent ^scperiences of 
the control gro\:qp wembera following t^ieir enroll^nt in the demonstration, 
in order to gain some general sen^ as to the nati;Lre of the en^loyment 
problems face4 by that' part of the youth population to ^ich Supported 
Woarfc is directed. St4>sequently, we describe the Supported Work exp^ri- 
ences of the youth' in the esqperimental qxoMp and their assessments'^ 

these experiences* 7n'the sections detailing our results on the effects 

' . - <^ - 

•.of Sijpported Wqrk we discxiss the following: , , 

• ' y r 

\ 

e The short- and long-run ixnpacts of this-program 
experience on overall enployment rates, s enployment 
levels, earnings, and wage rates , ^ 

4 

e The extent to which program iirpacts vary across 
sites or. among different subgroups of youth 
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• ^i^e thar ^tJh[ii( ^inipipymerit character- 

_ is,Ucs .o lea^r^M -general ijnprove- , 

nient :innvtAe|»^r^^ tb' bpntrols 

tiiatif^^^ :not fhave ^liioifn ' % knd earnings gains 

^ e The; iniE)a^^ on labor-market status 

and :job-sea5 i^ehayior 
• * * ' *^ . • - 

• The effects of. Supported\Work on youth's acqxiisition 
V of formal education and training 



In the final section, we smaroarize the findings and present some suggestions 
for future program strategies that might further our knowledge of the 
problemis, if not provide actxial solutions. 



A* EMj^YMENT EXPERIENCES OF .CONTHDL GROUP MEMBERS ' 

J As noted in Chapter IIv over 20 percent of the Si^jported Work* youth 
sample had never Hel<J a regxilar job prior to enrolling in the demonstration, 
ahd only about one-fifth of them had held a job within the three months 
preceding their enrollment,. However, as seen in Figure 111,1, both the 
incidence of ertployroent and the average auiiber of hoxirs worked per roon^ 
tended to increase steadily throu^out the follow- 1^) period.-^ During the 
first three months, 29 percent of the control youth were employed some^ of 
the time. For the total grovp, the average time worked was 31 hpurs per 
month (109 hours per month^ among those who worked) . By the start of the 
third year after enrollment, however, half of the youth cont:.-ol group 'were 
employed. The average time" worked was 70 hours per month (138 hours per 



1/ 

— This upward trend in enployment among the youth sample is far 
sharper than that for the otiier Supported Work target groups. By the end 
of the study period, yov':h cpntrois were working 20 to 40 hours more per 
month than- their countr ts in the other sanples* 
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•Ai TREND IN jpfilCENTAGlE! pF. QONTSOLS* EMPLOYED (YOOTH SAMPLE) 
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B, TBEND IN AVEBAC3E HOtJBS WORKED PER MOSTTH BY CONTROLS "(YOOTH SAMPLE) 
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Month 
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MO.TE: ,Th«s« figurss were plotted from data presented in Tables III. 3 
and ill . 4V * resnecti-;ely . 
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*4*onth anipng those employed).^ This upward trend is due to three factors i 

One is the natural phenomenon by which spm of those' youth (ail of whpm 

were by definition uneionployed a^ the '^s tart of the period) gained enploy- 

ment through a process termed "regression to the mean/* A second factor. 

\B that these youth were getting older# and youth employment rates' 

2/ ^ 

generally rise sharply with age.— The third factor is the general 
improvement in the labor market, particularly during 1977. 

Few characteristics distinguish those with more post^enrollment 
employment experience fr6m those with lesd. During the first 18 mon| 
after enrollment, controls in Jersey City amd Atlanta tended to wo;fk ^ 
significantly more than controls in the other sites, perhaps a^v^ result 
of the relatively higher ratio of CETA jobs to the youth population in 
, those sites.— Calendar time also tended to be an in5>ortant detehainant 
of controls' employment, with the later enrollees working significantly 
more than the earlier ones. In termsj of personal characteristics, however, 
only sex and prior work expearienc:* seemed to be inpori:ahtL. Males worked 
significantly more than females, amd employment was positively and 



^Eighty- three percent of the youth controls held soma job during 
the post-enrollment period, broken down as follows: 78 percent of those 
with 18 months" of follow-ip data; 83 percent of those with 27 months; and 
93'percent of ^ose with 36 months of follow-vp data. 

-^For example, in 1978 ^Jie national unemployment rate was 19 percent 
among 16- and 17-year-olds, 14 j^ercent. among 18- and 19-year-olds, and 10 
percent among those age 20-24 (Table JW20, The Enqployment and Training 
Report of the President , U.S. Department of Labor, Washingt9n, D.C. , 1973) . 

-^^Between 7 and 10 percent of the Jersey City controls reported 
holding CETA jobs, and up to 30 percent reported holding public-sector jobs 
during each 9-month follow-up period. The comparable figures for Atlanta 
are lower but still substantially above the average for the other siter- 
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significantly relatedi to prior woxk experience.^ In part, this limited 
ability to distinguish eunong these who aire more versus less likely to be 
employed is relaj^d to" the fact that these youth tend to exhibit consider- 
able instability in their enploytnent. Those who were employed during the 
follow-\^ period hold two jobs, on average, and the average spell of . 
employinant was just over five months. 



B. THE SUPPORTED WORK EXPERIENCE OF EXPERIMENTALS 

Hie design of the Supported Work pro^raun is predicated on the 
belief that the 'principal, factors contributing to the enployment problems of 
the targc^t populations are .poor work hed^its) and a lack- of basic job skills. 
On this assunqption, an opportunity to work in a si5)portive environment witli 
gradually increased standards of performance would permit the development 
of good work habits while simtiltaneously building yip basic employment 
credentials • From the outset it was ^recognized that there would be 
considerable variance in both the ^me it woiild take a target-grotjp member 
to acquire work skills commensurate with general market standards and the 
amount of wQrk e:5)erience that employers v/ould view as convincing evidence 
of job readiness. Furthermore, there was a strong cAncnitment to the 
concept tl^at Supported Work is a transitional program. Thus, in an* 
effort to balance the objectives of permitting sufficient program experi- 
ence to acquire the intended progrcun benefits and of ensuring that the 
programs not take on the character of sheltered workshops, the maximum 



-^Surprisingly, the estimated increase in employment with" age was 
relatively small and not statistically significant. The regression results 
from which these conclusions are drawn are presented in Appendix Table A. 5. 
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allowable time one .could pcurticipate in Supported Work was limited to 12 

months in .Atlanta and Jersey City and 18 months in Hartford, New York, 

and Philadelphia.— 

On average, the youth stayed in Supported Work considerably 

shorter periods of tim than allowed imder progratm 9\iidelines« As seen 

2/ 

in Table III.l, 29 percent of the youth stayed three months or less,-' 
and only 25 ^percent stayed as long as 12 months- 'The average lengtlt^f 
participation was 6.7 months. However, there was considerable variation 
across sites, with those in Philadelphia staying Ifess than four months^ 

9 

arid those in Jersey City and New York staying an average of just oyer 
eight months. There was also considerable variation in the length of 
stay iii the p2jog*.am among the different analysis sait5)les. Most notably; 
those earliest enrollees for whom we have 36 months of follow^p data 
(the ^36-month sample) stayed nearly on^- month longer than average. This 
longer avier^g^ sta^ is due largely to the f^ct .that over half of this 
saropLe is from Jersey City, where experimentals stayed in the program the 
longest; but it is ^Iso due, in part, to the more relaxed termination 
policies of programs during the early period of their operation when their 
job-placement procedures were still xn the formative stages. 



1/ 

— This program time could be extended over a period of between 
15 and 21 calendcu: months, respectively 5 if individuals had accumulated 
inactive time not diae to punitive suspension. Furthermore, all individuals 
who enrolled prior' to. January 1, 1976 were permitted to participate in the 
program for up to 15 months, on the belief that programs had not yet 
d(6VBlQped strong job-placement services. 

.^Fewer than 3 percent of the experimentals failed ever to appear 
for their Stpported'^Work jobs. 
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2.1 / 


i.a 


11.7. 31.5 


9.^ 


10.0 


' 1« 


0.0 


0.0 


O.O'^ 24.1 


8.3 


.4.6 


(Av«rag« Munbtr of . 
;ionths in Fro^raa)^ 


(6*7) 


i 

(5.9) 


'(8.2) ^8.0) 


(3.7) * 


(6.7) 


* B* Ftrcontaool3istributioa 'oy AflMunt of FollowrUo Oat» 




IS Months 27 Months 36 Months 


Total Samplt 


Still in Irogfifli at 
end of Mon^ 


<• 








s 


3 ' 


70. S 


71.2 


• 72.6 


71.0 




6 


46.7 


30.4 


56.5 


49.4 






32.0 


39:2 


' 41.5 


* 36.1 




12 


26.7 


18.6 


32.3 


24.8, 




15 


11.4 


5.0 


^ 16.1 


10. 0 




. 18 




. 0.9 


1.8 


4.6 





(Avaraga Nuinbar of . 

Months id Prograsi)-^ 



•(6.8) 



(6.3) 



(7.6) 



(6.7). 



HOTS: Savplas ara dafinad as spaeifiad in Tabla IX. 2, axcapt that tha 27- 
and 36*Bonth saoplos must hava cooplatad all praviously schadulsd 
intarviaWs . 

^ Tha avaraga fangthNof stay difftars from tha month of tha fir^t . 
Supportad Work tarnlnation for two raasbns: soma individuals do not btg^n 
thair Supportad Work job laaaadiataly upon anrolling in tha dsmonstration 
sasipla/ and soma ra-anroll aftar a pariod of inactivation. 



.so 
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Hhllt the overall average length of stay conpares favorably with 
thii av«ri^ aiBOiont of tlioe spent by youth in either Job Corps or CETA 

4 

employment and with the average length of . time c-ontrol yputh stayed in^ 

their jobs (5 to 6 months) / tljere is stLll soma question^as to v^y tihese 

ft ' " • ^ 

youth sttyed in the program such a ttiort time in relationship to the 
prpgram's policies of permittin'g L2 to 18 months of participation.-^ Had 
"these youth acquired the job xSkill^ necessary to find non--pzogram eiqploy-* 
ment in a significantly shorter period than anticipatea would be required? 
Could they not meet the performance standards -imposed even by the Supported 
^ork program? Or did they siisgly not ^ant to wcnrk? As can be seen from 
the data in Table 111^2, each of these factors probably contributed to the 
overall result. Eighteen peircent of the- youtih. left prior to exhausting 
their allotted time in order to take another -jo^ or to enroll in -an 
education or job-training program^ 43 percent left' for reasons related to , 
thrfir job performance <such as low productivity^ failure to ^show Mp on 
time ^ 'conflicts with the boss or crey) # and 31 percent reported more neutral 



Reasons for haviri^ left (isuch as low pay and health, and childL-care or 

, ^ 2/ " ♦ 

transportation probleus) Less than 3 percent of the sample reportec 
having left the program^cause they did not want to work. 



1/ 

Length of stay does not vary with the program's policies on 
maximum allowable time in the prograun:- aunong those in sites with a^ 
12-month policy (Atlanta and Jersey City) , youth stayed in the program an • 
» average of 7.7 months as conpa:ced with the overall average of 6.7 months. 

•^These figures on types of terminati'bnsV which were generated from 
interview data^ show a lower percentage q^^oth positive and negative 
terminations and a higher percentage of neutral terminations than those . 
reported in the Stpported Work demonstration's Management Information System 
(MDRCr 197a arjd MDBC^ 1930). Explanati,ons :;for theso discrepancies inciLude ^ 
df f forences in 'the tixr^ periods and samples' covered^ 2is w^ll as unavoidable 
aiffierences in the acttial'., definition of categorie^s. Furthermore^ the MIS 
data are based. \:pon progr2un operators' classifications of^« reasons as opposed 
to 1 those of. participants^ and 'these two groups mjiy have different interpreta 
(tions of the reasons for a departure* / 

' <■ " ^ ' . \ 6b ' . ,. 



■ TlBUoin.2 
RIASONS FOR UUIV^NQ SUPPORTSD WORK 
YOOTR E»ERIlffiNTAL- 'SAMPLE 



J* : 



A. ' Percmf oe Dl«tribution by Site 

, ; . Jersey Mew " Total 

Atlaiit'e Hertford City York Phlledelphia Seaple 



lidiaufttd Jllloii«bl6 
TiM in Frogruil/ 


. . 22.9 


0.0 


25.0 


8.9 


0.0 8.5 


To Takt Ahcthtr Job 
or Enroll in School 
or Job Traiiiing 


14.3. • 


19.7 . 


16-.7 


12.5 


38 .'5 18.0 


' b/ 

Poor- Pf rf orwanct 




45.8 . 


'31.3 


51.8 


53.8 42.9 


Other 2/ 


.34.3 . 


34.5 


27.1. 


26.8 , 


7.7 30.6 


B- Percentaoe Distribution by Attount of Follow-Up Data 




18 Honths' 


27 Months '36 .Months 


* 

Total Saniple 


Exhausted Allowable 
Time in Program i/^ 


. 8.4 


5.5 




27.8 


h 

8.5 


To Take Another Job 
or Enroll in Schoi^l 
or Job Training 


15.7 


* 

19.1 




33.3 


18.0 


b/ 

Poor Performance 


42. ;3 


45.5' 




27.8 


42.9 


Other 


• 33.1 ' 


30.0 




11.1 


30.6 - 



NOTE: For •dafinition of sanples^'see Table III.l. , ^ 

^ This includes individtaals not leaving Supported Work to take another 
job, to enroll in school or job training^ .or because of poor performance, but 
who either spent* the maximm ntlmber of months in the program or exceeded the 
maximum calendar time for participation. ^ 

^This category includes those terminated because cf conflicts with 
the boss or crew members/use of drugs, or alccholr illegal activities or 
incarceration, absenteeism* poor punctuality, or low productivity. 

. S/n 



^his includi**^ reasons sufeh as low pay and heauLth, and child-care or 
transportation problems. 



The likelihood of terminating for positive reasons was significantly 
related to having enrolled in the denonstration early, having more than 9 
years of education, and not having a criioinal history • The only factors 

c 

significantly- related to terminating for negative reasons were being in the 

• New York site and having had -limited or no prior work e^qpqrience 

Participants' a^ssessments of Si^jpoJ^ted Work indicate that a majority^ 

.of them (62 percent) felt that Si:^ported Work, did not prepare them to obtain 
2/ 

a regiilar job.-^ This sentiment coiald partially account for the hicpi ra*:e 
of early 'terminations from the program. , However, in general, efforts to 
identify factors related to length of stay in the program led to the cpnclu- 
sion that those who stayed in Suppbrtc i Work for varying lengths of tims 
left for qioite different reasons. Those who enrolled during periods of 
relativitjiy favorable labor-market conditions, and males, tended t"^ h've 
more employment opportunities and to stay in the program for shorter 
periods of time than otherwise similar youth enrolling during periods of 
worse lai)or-market conditions and ^an" females, rt. pectively. But control-* 
\ling ^or other factors, we? also obseirved that youth with the le^st education, 
job training,*^ and prior work experience tended to be relatively short-term 
stayers despite their more limited alternative' employment opportuni'd.es.^ 



'^'^These findings are based on polytomous logit analysis of ter^^iin- 
ation types (see /^pendix Table A. 7). 

* 

2/ 

^ Three-fourths of those vAio did feeP Supported Work helped them 
saiid that it helped them" by teaching job skills and, trades v More detail 
on participanl^' attittides toward the program is presented in Appendix . 
Tables A. 8a and A. 8b. 

3/ 

-/The regression estimates from which those conclusions are dra^ 
are presented in Appen<lix Table A. 6. • ^ * - 
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4. 



still another question that arises is whether those 9^ percent who 
exhausted their maximum allowable time in the program would have benefited 
from a slightly longer peripd of enploymsnt in Sx5)ported Work. There is 
no indication that there would be any long-term benefits from lengthening 
the program eli^bility period. First, we observed no relationship between 



the length of time youth stayed in St:g?ported Work and their subsequent 

• iV • • 

employment gains.— Furthermore, the post-program en^loyment experiences 

of' those i^o exhausted their allowable time in the program were more 

favorable than tiiose of youth who left the program for other, "neutral" 

reasons and only slightly less favorable than those of individuals termin- 

' 2/ 

ated for positive reasons.— * 

* Subsequent sections consider in detail the actual intact of this . 
Supported Work experience on enpJ.oyment-related outcomes . In the context 
of these discussions, other aspects of the Supported Work -e:^erience, such 
as job-placement assistance, are discussed. 

C. OVEPALL EFFECTS ON EMPLOYt&NT AND EARNINGS * " * 

Offering youth an opportunity to participate in Stjpported Work did 
have short:-r\in benefits in terms 6f eir^loyment rates, eirployment levels. 




1/ ^ ' 

— Appendix C describes the formal analysis undertaken to ^scertaiiy 
whether c not program iirpaqts were affected. by tAe length of time an 
indi^dua. stayed In Supported Work. 1) * . 

'-^For exanple, 40 percent of those who left Supported Work afteir 
exhausting their allowable program time found other eitployment, within one 
month, compared with only 25 percent of^those who left for other, neutral 
reasons. Over the period of N^bservatioPf SO^percent of the "manda\:ory 
t^rminees," compared with ^0 percent of the ^positive terminees,". entered 
regular employment, although the mandatory terminees spent an average of 
two months longer in. job search than did the positive terminees (see 
Appendix Table A.9). • 



diid earnings.-^ However, the results of thi's evaluation suggest that those 

impacts were due entirely to eisployxnent' an Supported Work*. Upon leaving 

* ' < * * 

their SiJp^orted Work jobs, es^erimental gro\:p znainbers were about as equally 
likely as conti^ls^ to" find non-program jobs. The two groups averaged about 
the same number of hours- of ..work per month and earned similar amounts in 
these^ jobs. 

The general trend in outcomes can be seen from Figurs IIX.2, ^ich 
shows ^the average hours worked per ioonth by e^qperimentals as contra, ted 
with controls^ The large eroployment gadns during the first few months 
dedii^ed sharply as e^^erimentals left S\:pported Work; .and by the start of 
the second y^ar, v^en less than 20 percent of the es^rimentals were still 
in the program^ there was essentially no difference in the overall eioploy- 
ment levels of e^^e'rimentals and controls. 

This trend is the i^esult of changes in both e'sployment rates and 

hours worked by those who were enployed. As'^seen in Table III. 3, during 

^the first three months. after enrolling in the Srppprted Woric demonstration, 

almost all of the e:q?erimental groi:?> (97 percent), as conpared with only 

29 percent of the' control ^^rox?>/ repori:ed having some enployment. Ninety- 

2/ ^ 

three pe;rcent of the eixperimsntal group i Stpported Work jobs^ and ^ 



> — Earnings data from Stpported V7ork interviews were conpar«d with 

those maintained by the Social Security Administration, primarily assess 

tihe potential usefulness of Social Security data for a long**tsrm follow-\?) of 

^the sample (see Masters, 197^}. .The results of this comp«krison show 25 to 

45 percent higher earnings reported in inte^ryiews, at least partly ae a 

result^ of some employment not being covered by Social Security. However, 

estimates of e^^erimental-conljrcl^ differences were simJ.l^r for/the ^two 

data so|irces. ' * ^ . . 

• ■ * ' • 

^ -^As already mentioned, le^a taan 3 percent failed ever to show tp 
for their Stpported Work jobc However,^ the follow-tp interviews 'did- not 
record 4ata on periods of ecployment shorter than half a month, Wiich is 
vAiat accounts for the -higher rate of those with no record^ of ;a Stpportcfd 
Work job.* ' * ^ * 
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?I<30FE III. 2. ' ■ 

TIJEND Hi HOORS ^.WORKED PER MONTH 
YOUTH-SAMPLE • - / 



« 



Hduirs 
per 

Month 




U • 13 It 21 24 27 30 33' 36 



Months After En^ollmtot 



NOTOS: • .Data plpttadin this fi*gur« are. reported in Table III -4. 
' E.'i«rimfcital-coAtroldifferenUais are xsig. if leant on^^ 

NO e»*riin«ntals sho'uld have be<. in Supported Work' beyond, the -21st »onti.u 
■" That some report • Supborted Work hours during months 22-27 may be attributable- 
to either" data errors or. to occasional failure on the part, of program 
operators ,tb. jienainate individuals p romptly upon expiration of their ^ 
' «ligibiUty-p«riod. *„ ' ' • ' 



^'>;r'Cf^v ^ -N' 



. TABLE .111.3 , 
PERO^itAGS: EMPLOYED 
YOOTH SAMPLE, 





• 

EiqpexiiMntal 


Ccntxol . 


E3p<sri]p|ntaiv 
Contzol 


•Perca»ntag« of ^ . •• 
ExpsriaiBhtais with:?/ 
Any Sijpported Only Si^pcrted 
Vo& job Work 'jobs 


^1-3 


■ " 96.5 


28.7 


67.8** 


. 93.0 - 


. 84.7 


4-6 


81.8 


38.9 ' 




'. 67:6 


61.8 


7-9 


68.2 


. « 40.8 


27.4** 


49.9 


44.3 


10 - 12 


S4.a 


36.0 ' 


18.8** ' 


32.3 


28.8 ' 


13" - 15 


51.0 


46:7 


4.3 


19. fl 


15.3- 


IS - 13 


• 45.1 • 


AT O 

t 




• fl •? 


5.5 


19 - 21 


45*.^ . . 


42.4 


2.*.' 


1.7 


' 1.7 : 


22 - 24 


47.0 


' 49.1 


-2-1 


1.2 


1.2 


25 - 27 


51.3 " 


51.0 


0.3 


0.8 


0.4 , 


28 - 30 


51.0 

3 


48.5 


2.5 


• ^ . '0.0 


0.0 


31 • 33 


59.5 


54.7 ' 


4.8 


0.0 


0.0 ' 


34 - 36 


57. 5 


49 lb 


7.5 


0.0 . 


• 0.0 



NOTE: Excapt vAare notiaid^ all data are regression-adjusted. ^Control vari- 
aisles used in tna regxassions' are lis^ted in i^pendix Table A. 4. The 
, sas^les used are deflxied in Table II.2. ^ 

^-^These data are hot regression-adjrjsted* 'No e^qserimentals should have 
been in Supported Work beypnd «bnth 21. That some reported program participation 
.in later months reflects elthei-. data errbrs or failure by program operators to 
terminate ihdivlduals on' schedule, t • ' 

^statistically sigp:|ificant at the iO percent level. 

^^Statistically sidilificant at the S percent level-. • • ^ 



Sp.i^rcent^ of those with hq program job wei^e enployed—re fleeting, perhaps, 

spiae^self-»selection aunong those not choosing to enter Si:^ported Work or to 

.tejnnina^ Mxly.. During inon^-Jb* 4 to- 6, 82 percent of thet-e^qperiinentals 

- - ... 

weM' esoployed: nearly a. third of them were no longer participating in 

Stppqrted W6ric> but about 40 percent, of these former pjirtiqipants held 

npn-Si^ported Work jobs^ During this same period, the percentage of _ 

controls vrtio had spiae enployment increased and the resulting differential 

In. enplpyment rates between the tv^ gzoi:ps was 43 percentage points. 

This trend of a *high rate of, depaurture from Supported Work con- 

,tinued through the next two quarters/ wxth^^uccessively lower percentages 

of e^^rimentals finding non-program jobs ijpon leaving Sijpported Work and 

the percentages of controls who were, enployed staying r^spnably constant 

(36 to 41 percent). ^Over iSonths 13 to 27, however, overall enployment 

rates were siimilar between- exper?.mentails and controls, ranging between 42 

arid 51 percent \n the various time periods* • This similarity in rates is 

/ • ■ * 

due, in part, to a rise in the control group's enployment of about 10 
percentage points during the, first quarter of this second ygar, but also 
to some oontin\:ied decline in experimentals " eitployment through the 21st 
month* 

Virtually all experiitentals had left Sipported Work by the 22nd 

< ^ \ * ' 

month a'fter enrollment^ however, and there was, thereafter,'^ slight 

upturn in their enploymen^ rate: by the end of the third year after . 

eiurollment in the 6b ^ stration, 58 percent of the e:5>erimentai3 and 

" ^ • = ' 1/ . 

50 percent of the controls reported some enployment.--' 



* ^ .^It should be rioted that this a percentage-rpoint differential is 
based on few-* observations (153) and is not significantly different from 
zero* ^ 

''.'■/• r \ 73.88 . 

::-V':r-hJ^- i:--:. h 1: 



A« we ha^t seen from Figure Ill»2f the pattern of results for 
total, fipurs eaeloyad (both Supported Work and non-Sipported Work jobs) 
parallels those for enploywnt rates •-^ As indicated by the data in 
Table .11144 r the main source, of the decrease in the eacperixnental-control 
differentiail.* over the year following exirollment is the sh^rp decline 'in 
Stpported work ei4>16ycient, from an average of 131 housrs per month during 
the initial quarter to 46 hoxirs per month during the foiirth quarter. 



Only» abpiit one-foiirth of this decrease in program hours was offset by the 
rise 'in' eaqperimental^' noh-progr^ FurtheriKiore/ controls 



increased thei^ enp\oymen^ by. 61 percent over this same period, from 31* 

to 50 hours per month, ^us, 75 percent of the decline in the experimental- 

contTOl differential, in hours worked durihg ti. s first yearSt§ due^ to a 

reduction in the employment of experimentals, and the remaining 25 percent 

*• ' * ' * 

is attributable to a rise in tlie employment of controls. ^ 

In the 12- to 15-month period after enrollmsntf nearly 60 percent 

of those vAio had stayed in the program for as long as 12 months left, 

largely because they had exhausted their allowable time in Supported Work; 

and the iiamediate post-program 'anployment^experiences of this group tended 

to be less fayorablA than the average for controls^ , Conseqwntly, the 

Jexperimental-cbiitrol differential in hours worked. dropped essentially to 

zero. It was^not until the- 28- to 36-month period* that e>?)erimentals' 

showedf any evidence of employi^ent gains relative to*' controls. Even then, 



-^Appendix Table A. 10 'presents a distribution of the average number 
of hour;B worked and earnings per month diiring each §-month period following 
enrollment! ^ ' * • ^ "o, ^ - 



TABLE: III. 4 
HOURS WpMED PER MONTH 
YdCffl SAMPLE 



Months 



Grbtip 
:Heahi 



^Control 



* Control 



Supported Work Hotirs 
As Percentage, of 
To tii •Hours oi 



1 




-rr- — 1 I ■ 


4 




131.1 • 


,,91.5 


4 


- 6 


120. 1-- 


. 43.9 


76,2** 


96.2 


80.1 


7. 


- 9 


97.1' 


44.8 


. 52.3**^ 


70.5 


*72.C 


10 


r 12 


79.4 " 


JO. 2 


29.2**^ 


46.2 ' 


58^2 


13 


- IS 


.67.2 


62.2 


5.0 


21.4 


31.9 


16 


- W 


60.4 


. 61.3 


-0.9- 


8.8 


• 14.6.. 


19 


-21 


64.4 ' 


•63.6 


0.8 


2.4' 


3.8 


22 




.69.6 


~ 70.0, . 


-0.4 


2.0 


2.9 


-25 


- 27 . 


69.1 


' 70.. 4 


-1'.3 


0.6 


0.9 


28 


- 30 


87.2 


83.0- 


4.2 


0.0 


0.0 


31 


- 33 


•92..8 


^ 82,2 


10. 6 


0.0 


0.0 


34 


- 36" 


83.3 

1 


75.8 




0.0 


0.0 



NOTE: S«« not« Table III. 3. " ' 

Over^ll^e^qpsrijnental-control differentials anw» control-group means may 
vary= somewhat from the dveralges reported in Tables III. 6, III. 7, and 
III, 8 due to slight di'ffer'ences in samples. 

These data are not regression-adjusted. Mo ejcperlmentals should have 
been in Si^portisd Work beyond month. 21. That some reported ptcgram participation 
in later ^months. reflects eit^ier data errors or failure by prograa operators 'to 
terminate individuals- on schedule. ' 

♦statistically significant at the 10 percent lev^l. 
**Stati;5ticaliy significant at the 5 percent leVel. 



however, the differ^ntials^'observed were neither large nor significantly. 

aiffeTeuc from zero,-^^ 

The results for earnings (gross) a.re presented in Table HI. 5. 

For the first. 18 inonths following enrollinent, these resiJlts parallel those 

for employinent rates and hours worked,-^ However, over the 19- to 36-iaonth 

period, there was a shift in relative wage rates from eaqperimentals earning 

somewhat, more *per hour than controls to their earning substantially less 

3/ 

($3.93 versvis $4.37) in the, last quarter of the;third year.— The result 

« 

of this shift is that, viiile point estimates of hours and employraent-rave 
differentials are positive (though nbt significant) in the later periods , 
those for eai^iings are negative but, again, not significantly' different 
from zero. 

« 

While the overall results indicate qiiite clearly that Sn>ported 
Work has not significamtly influenced post-pjrogram enployment of youth, 
the pattern of resiilts observed for the different otltcome measures does 
raise, a number of questions. The two main questions are whether the 



-/Tobit escimates of experimental-control ^fferentials .were quite 
similar to those,'^ reported in Table IJI-.4; they indicate that in. each time 
period/ rojaghly half of the differential in hoiirs worked is due to differ- 
^ ences in enploymeht rates and thfe other 'half to differences, among those 
employed, in hours worked {s^e Appendix Table A.Jl). ^ 

. -'^If all earnings data , are' inflated or deflated to eqtaivalent 
dollars as of the fourth qpart^r of 1976, e:q?erimental-control differences 
are slightly smaller. On average, the absolute vedue'of the differential 
will be ahout 10. percent smaller durinc ^the first nine months, 5 percent 
smallef^uzing -the second, 18, percent smaller during the tfiird, and 11 
percent smaller over the fourth. Estimates are that 10. to 15 percent * 
gross ear)>i/*gs were paid in' state and local income taxes and'.in Social . 
Seciirity fcax^s.^ ' . * * • ^- > - 

•^These wage rates are calculated by dividing the average earnings 
per month .(T3ible III..5) by the^ayerage number^of hours worked per; mon.th 
(Table III. 4). For the, reader's convenience, thes^ wage-rate calculations 
are presented* ih Appendix Table A. 12. 



. iRBLE III..5"~,,- 
CELLAR EAUKiNGS ijER MONTH (6B0SS) 









. YOUro: SAMPLE , . 




t 




Months V 


E:spei:ii|iental 
%eah 


Control 
neon 


•Contir.ol 
uxxxerenuax 


Supported Work Eaminar: : 
'i» :P.ercentager?9^^ ^ 
iTbtil^^^^^^ 
Dollara-' ^ Einieriiiiehtals ^ 


1 ' • * 


1 r 3 


' 389 .52 

* 


100.15; 


28'9.37** 


353 . 90 


90.9 




4*6 


340.76 


140 i 51 


206.25** 


266 .'80 


78.3 • 




7 • 9 


. 284*40 


138.24^ 


146.16** 


197.20 


69.3:. _ 




10 • 12 


255.24 . 


163*51 ' 


91.73** 


134.10 


' 52.5 


f ' ' 


13 15- 


218.79 , t 


'2il>16. , 


7.63 


63.33 


28.9 ■ 




, 16 - 18^ 


^08.78/ " 


213.^4 


■ V -4.26 


2R.23> 


13.5 




' 19 - 2r 


246; 22 '■ 


220.85 


25.37 


9.33 - . 


3.8 


> 

1 


72 24 


270,.77 


256.01 


14.76 * 


7.75 


-2:9 




25^27 : 


265.98 


268.05 




• 1.63 


0.6" 




is - 30 . 


'300.95 . 


323.53' 


-22.58 


0.00 


0.0 




3; - 33 


323.60 


347.73 


-24.13. 


0.00 


0.0 




34 - 36 


.-287.13 


331.59 


-44.46 


0.00 


O.C 



A. 



NOTE': ;see note to Table 111.3. ' 

Ove»*all e:iqperimehtal-cdntrol differentials and control group means way vary 
somfcwhat from the averages repbfted in Table 'ill. 6 due to slight differences 
in the samples. 



-a/ ■ ' ' . . 

- These data are not reggeission-adjusted. Mo ej^elrimentals should havfe been 
in Supi^prted Work beyond mont|i^2i'. That some reported -program participation in 
later months reflects eithef^lata errors or occasional failure by program operators 
•to terminate iiidividuals on schedule. ^ ' ' ' • 



*Statisl;ically significant at the 10 percent level. 
**Statisticaliy significant at the. 5 percent level. 



results estimated for months 19 to 27 and 28 to 36 are generalizedjle. to 
those that could be eo^Jecte^fpr^^the fiall sample, and v*iether the pxSgram's 

"""" —I • . • » ^ * ^ 

in4)act Was significantly affe;5ted by ^e fact that some esqperimentals o 
•received unenployment coitpensation' upon leayin'g Supported Work. We con- 

0 • ' ' « * 

sider these below, as' well as other issues thdt might e^^lain the pattern 

* ■ ' • 

of results. 

* * . 

1. General izability of Later Period ^Results to Full Youth Sample 

As can be seen from Figure III. 3, prograin iirpacts differ substan- 

' ^ ; " 1/ • 

tially among those groii?>s with "various amounts, of follow-up data,— 

suggesting that the longer-te^rm resxats estimated from the subsanple vSio 

were cissigned ax]^ .completed a 36-month interview may hot be generalizabie 

2/ 

to the entire demonN?t ration youth sample.- Two factors are partictilarly 
relevant to this conclusion. One i^ the overrepresentation of Jersey 
City in the 36-month sanpler^ and the other is the differential \n enploy- ^ 
ment patterns among controls' in the various subgroups. [ 



'» « 
.-For computational ease, svibgroup^ were defined accozrding to the 
amount pf available data rather 'than the types of interviews scheduled to 
be con5>ieted. The slight differences, in sample definitions have been found 
not to affect ^e conclusions. ^ As' noted in Chapter II, 35 percent of -the 
youth saniple w^' followed -for 27 months and 14 percent was followed for 
36 months. The' remainder -of the sample completed only an 18- month (interview 

•^To 'ensure- that changes in results over program time axe dtae only 
to changes in e35)erimentals * and controls** behavior and jnp^ to changes in 
sfiurple conposition, results plotted in Figxire III. 3 pertain.;.only to those 
individuals 'for vrtiom continuovis data throughout the follow-up. period are' 
available. . ^ ^ f# , 

' ..-^Jersey City eiiitollees. constitute^S'' percent of the subsanple 
with 36^ months of'^ta but less than 20 percent of the total youth saitple. 
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.TBEHD IN HOURS WORKED PER MONTH Br'SOBSAMPLES WITH VARyiNG AMOUNTS OF POLLOH-UP DATA 
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These data are not regression-adjusted. Figiures used, to plot the graph are prese^nted in Appendix 
'Table A*13; \ • 
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18 = 18 Months of Follow-up Data 
27 = 27. Months^f Fol^w-up .Data 
36 = 36 Months of Folhsvyrup Data 
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Over the IO7 to period, differentials tended to be substan- 

tially larger for those with 36^nths of follow-up data than for those 
whose last interview- was 18 or 27. months after .enrollment, largely as a • 1 
reitat of di,fferentials in the enployinent levels of controls, . However, by 
the 19- to 27-roonth period, a more cotjplicated pattern of resiilts emerged. 

For exanple, the positive 16-hoar differential obsSrved -for tAe* 
36-inonth* cohort in months 16 to 18 disappeared as controls (primarily among 
the. Jersey City -sample) increased by 89 percent their average houris'of . 
work, while experiroentals increased their eTi?>Ioymejit at a more modest rate. 
The sh&rp uptujfii in. results between months 25 t6 27 and 2a to 30 for this 
36-»fflonth saitple- is attributable to an extraordiharily large increase in 
experimentals-' A?i5!loynient relative to 'controls* (30 versus 4 hours pef 
montti) , agai-n a \rehd due primarily to changes in behavior of. the Jersey 
aty sait5>le.-^ In contrast, experimental-con differentials for the 
subgroi?)' with 27 months of 'follow-up data becaine increasingly positive / 
over the 19- to 27-month period, as experimentajcs ' en?»loyment increased 

. ^ V ' ■ ' • ' . • • ., 

fester. than controls' and than that of experimentals in the 36-month sub- 

/gzovp. The lower enployment" among controls .and higher employment, among 

• ■ ^ '. , .' • 

, experiment:als in the 27-month subgroup 'relative .to 'those in the 36-month 

groyp is 'due entirely to a lower '.rep r^ sen tatiofi p,f the Jarsey City sanple. 

in the^27-month ciohort. Abstracting from this coh'^uncan^^ influence of 

the Jersey City sample, the ge^jepkl patjtern, found for other Simported ' 



> 1 



•^Controlling for site, controls' enploymsnt in. months 19 to 27 . 
-is lower among the 36-month d9h'ort and experimental-control . diff4re.ntials 
areYarger--: The peculiarities/ of th, Jersey City 36-aonth Eubsai»ple are 
liJcely to be due' in 'part to extraordinarily high UC receipt amon^ <experi- 
meiitals in €his grotip relat>ive to controls , and ralatic.'S t9re.^erimentals 
in the '27-nonth 'eobort (see Figure 111.4). , J , 



Work target grotaps, of more favorable e^^erimeiital-control differentials 

/ • * ' 

t 

being observed among those grox^s where controls work relatively little is. 
observe'd for the youth saurple, as can be seen in Figiire III. 4. 

. ' A more conprehensive view of the nature and extent of s\ibgroup 

. ^ ' / ^ ' 

differences in outcomes can be seen from Table III. 6. As noted previously. 



' those controls with 36 months of follow-xop data tended to work and ea^ 
sxabstanjtially less during the 10- to IS-month period than did , controls 
followed for' shorter periods of time. However, these data indicate that 
controls in the 36-month spb^rot?3 worked at jobs paying .higher than average 
hourly wage rates (53.74 per hour versus $3.42 to 53.56 per hour for 'those 
with 18 arid 27 months of data) , while experinentals in the 36-month group 

worked at substantially lower wage rates than did experimenjials with less 

* O 
follow-v^data. Thus, earnings gains in months 10 "to 18. are small relative • 

to the hours Vains for this^sxibgrot^). 

Between months 10 to 18 and 19 to 27, among those for whom data 

•for both periods are" available, the observed sizable increase in the 

d;^rage.eir^loyroe:it among control grotap memb^s (from 51 to 68 hours), and the 

small change in ^the average eii5>loyroent among experimentals (from 66 to 

1/ ■ ^ , ' ■ 

68 hours per month)— was accompanied by a shift in the. types of eitployment 
of the. two groins of workers over time. Experimental grox^ members tended 
to shift from Si:5>ported Work to non-Si5>ported WorJ^ jobs, and those in the 
36-month sample working^in nonrprogram jobs earned siabstantially higher 
average hoyirly wage rates in the 19- to 27-month period than did those 



1/ ^ 

These, figures are the weighted average of the hours worked by 
those in the 27- and 36-month subgroups {.e.g., .72 times the value for 
the 27-roonth subgroup plus ,28 times that for the 36-month groi5>) . 



.^FIGURE III. 4 



TBBHD iN!4*URS WORKED PER MONTH BY SUBSAMPLES WITH VAWTING AMOUNTS OF POLLOW-UP DATA 




Months After enrollment 



NOTE: Ttiese dataware not ^gression-adjusted, 

I^Y: E}^riiaentals 18 « 18 Months of Follow-up Data 

- Controls 27 = 27 Months of Follow-up Data 

^ '36»36 Months of Follow-up Data 
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1"^ 
[MOTE: 



See not^ to Table III. 3. Together, these sasples include the 8a»e observations used to generate data xoported in Tables III.3 U 
III. 5. This total ^awple has been partitioned acou.-ding tn tlie nost recent interview assigned and coapleted. Continuous da'ta^ 
was not required for iocluslmn^o a subsanple, whil^ this requi resent was inposed for the samples used to plot Figure IK. 2. 



A«nng those with data fod^KHiths 10-18, 51 percent have 18 npnths of follow-up only, 34 percent have 27 nonths, and 15 percent 
i^ave 36 sooths; .Among tHose with data for nonths 19-27, 28 peipcenC also have data for 36 swoths. 



T^Wage rates have been cosputed by dividing average Monthly earnings by average nonthly tiours. 
;*are indicated. 

**Statistic«lly significant -M. the 5 percent, level. 
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Thus, no significance levels 



working an non-program qobs during the preceding period ($3.83'vers\is 

$3*li per hour), while those with only 27 months of dfta earned roughly 

' • * • / t . . — - . ^ ' 

the same wage rates during b^tli. periods ($3.80 versvis ,.$3-86 per hour) 

ThiiWthe decrease in e'arnings diffei;^tials relative to hours differen- 

tials betwee'n experimentals and controls duriug this period was substan- 



tially I'arge^r for th^ 36- than tor .the 27=!a(5rTth-subs dmijle. 

U As ndted earlier,, among the ,36-mbnth saxxsple, the^ upward trend xn 

V* ' 1 -7** 

employi^nt among both ej^erimentals and controls between^ the* 19- to 27- and the 

28- to^ 3^-moftth periods was due largely to the behavxor of Jersey Ci^ sample 

^' . • * ^ ^ ■ , 

members and was stronger among e:q)erimenta],s than among controls : experimentals 
U • * 

increased the ave^rage number of hours 'they Worked *pe]p month from 61\to 

^ . ' . \ ' 

89 between these two periods, wl^i le- cpntrols increased their enployment ^ 

' • '* • • ** \ ' 

from 59 to 81 hours per month. However, conciirrent with this increase\ 
. ^ • .... _ • \ 

• ^ , \ 
in experiment^Lls' en^loyment; t^eir average hourly wage fell by 34 cents\ 

per hour, while the smaller increase in en^loyment among controls was \^ 

* ■ xP^ ^ \ 

accompanied b/, a^ 6 percent .increase 'in Bioxirly wage rates. ,Th^^ net result 

^ " • ^- 

of these. ^shifts j.s the observed negative earnings differential between 

experimqntals^ and cofttxols. 

• V * -Based on the comparisons* 'of the behavior of this sample with that 
Q^the samples followed for shorter periods, we have little reason to ■ 
'e>5)ecl: that^a similar pattern of the en^loyment results would necessiirily • 
have been observed for the full sanple.. In fact, it seems- tanlikelx^that 
the ihverse'rel^tionship- between pitployment. and earnings differences would 
be .exhibited by the full sanple . ^ ^ - 



I^These wage rate figures are based on special calculations, and 
cannot be computed from data^pi^^sented elsewhere in this report. 



\2* "The:,inpact on Snployinent of Unetcployroent Condensation 

Al^ioitoh the initial intention of. the ^vpported Work design was * 
npt to hayp individuals become eligible for ilneii5)loyment coitipensation (UC) 

" on the -basis -p.f their Si5)ported Work employment, a sizable portion of - - 
both the^;Jersey City and New York ej^erimentals did receive benefits \^on 
leaving tJ!ie~pT(S^:twr ^^ ' F or t tie f u ll sanpl ev t lrenT~thgr e was a 6t 4 point. " 
difference in the percentage of ej^erimentals and controls who received 
UC during the 10- to IS-month period and a 3,5 point difference during the" 



, ^ ' ^ 2/ 
19-: to 27-fflonth period.— However, the diffez;entials were particularly 

large among the. 36-mohth sample. This raises two questions/ one.bein , the 

extent to which tiiis aLLternativis income sdurce reduced immediate post- 

program employment among e^^erimentals , and the other being whether the 
« »• ** '* 

pattern of emplgyment and earnings differences for "^the ;samples' with various. 

. v; 

.amounts of follow-up data is due, in part, to the differenticil intact of UC. 

• * 

Becaiise a relatively ^mall percentage of the total youth sample 
received UC benefits, their intact on overall program results has been 
estimated to be negligible.—^ Furthermore, even among those with 36 months 
of follow-up data, for whom the experimental-control differential in receipt 
rates was much larger (16 and 13 percentage points in-the-lO- to 18- and 



1/ ' ' ' 

— As previously noted, those ;in the Jersey City sample would have 

qualified tmder the SUA program, vAile the New York program participated 

in the state UC program. ' / - - > 

•2/ 

Y These differentials are considerably smaller than those estimated 
Nfqff either the AFDC or the ex- addict samples, but larger than, for the 
ex-offender. . . "'^ . 



^ 3/ 

— For exalnple, we have estimated that in the absence of any UC 
program^ total .hours differential .during months 10 to 18 and 10 to 27 
woudLd:>have been only about l^S hours greater than -those reported in 
Table in . 6. 



r 



.19- to '27-aDnth periods, respectively) , the "estimated iapact on eirploytneot ^ 
- , resists is TOlatively small,— and does not chang6_the» gerteral conclusions * 
regarding ,the genfraaizability of. tlie 28- to 36-roonth results to the ful-1 \ 
sanplay^ , ^ • ■ * ' ' * " ^ ~- - • 



3t — -^fe -^Eopo x L axiue .o f ,P ublJ :cr^'igtagg'"iag>roymerit: = ; ^ 

Xs indicated in: Chapter il, CETA enployment potentially could- be 

♦ .',>' ^ « * . . ' . « 

one of the main al-bamatiVes to Supported , Work for this youth ^grp\jp . Thxas, 

attempts were made to* dssess tfie extent to which the. availability of sich * 

iirograms contributed •to chc observed enployment differentials between 

k ♦ 

. e3q?e'r3.mental3 .and controls. . * 

Overall, relatively few (between 1 and 8 percent) in either the . 

\« 

• ■ • •. * , • 

experimental or ^control groi:© reported employment in CETA or WIN jobs. 

during 2my nine-month* period, and e^^^erimental-control differentials in 

the prevalence of, such jobs were low (-2 to '+2 percentage points).— Yet, 

the differential in earnings from CEfTA and WIN jobs during the 28- to 36- 

mon-th period is sizable and accounts for the. Icirge negative earnings differ- 

enticd: controls earned ^n average of 34 ciollars per month more thcui* did 
* • 

V e3qpelc£SentklIs/(see TablS^ -I^^^^ a-differential that .is^equal Jto^ tiiat in 

earnings from jobs identified by sanple members as being CETA or WIN jobs.— 
Purtheriiiore/ to the extent that youth failed to distinguish between CETA 

/ . „ . -^For exaitple, the* ho\irs differential during the 10- to 18-month 
period might be as much as 3 hours larger than estimated. * 

'2/ 

' See- Appendix 'JadDle A. 14. 

3/ ■ ' • ' ' ' 

-^No atteirpt was iqade in the interviews to distingiiish between 

CETA and WIN jobs. For the youth sample, however, most jobs will have 

'been fxinded under CETA. ^ ' ^ 



i"^: ^ ^ ^ ^86 1.02 



jobs 'and.. other government jobs, the above figures understate fhe in^ortance 
of stibsldlzed.employment/ since the differential between e^erimentals ' and 
controls' earnings frofa all government jobs, including CETA and WIN/ is . 
over ao .dolla^rs per month. •^'^ ^* • ^ - 

Thxasr liifferential access to CETA, WIN, cuid other government :^obs 
by those •e>5)erfmentals and cpntrc^s -with aS** months oi t:oilow^^i^~^t^~'i^r 
related to the lack of significant ibn^r-term eirployment in^acts of 



SijppbrtiBd Woric. However,, tdiis pattern 'of CETA, WIN, and govemmsnt eicploy- 

^ ' ' ' ' - 2/ 

meht is peciiLiar t6 this saiicle subgroup and past-enrollment time period.-- 

4. Other Potential ExgTaliations for the Qggerved Pattern of Penults 

It seems clVar that the results estimated for months- 28 to 36 on - 
the beisis of the 36-month ,sazaple are probably not representative of program 
effects one would expect to have observed if the full sajnple had been 
followed for that long. Furthermore, the unplanned availability 'of UC " 
benefits <o former S\5)ported Work participcints has hot significantly 
affected the program's inpacts. While differential access to public 
eit5)loymBnt by e:5>erimentals and controls is related to the observed pattern 
of resiilts, the reason for this rerationship is not clear. In an effort to 
determihe whetiier we could-at least draw.. some^conclusions as to the^ 
expected shift, in the estimates of long-term inpacts if the full seunple 
had been obsearved, we considered sevetal oth*e2> issues. One -of the more 



-- See Appendix Table A.14. As* noted later in discussions of site- 
specific resiilts, ±hese differentials dn CETA, WIN, and other public-sector 
employment between eajperiinentals and controls are due to relatively high 
rates of employnfeht in and^earnings— fTO . 
gro\5> memb^r^ in Hartford cUid J^risey City. As note^d in Table II. 6, CETA 
.jobs targeted at youth were relatively nbre prevalent in these two sites 
them tiiey were in other sites . - » . , 

^^See Appendix Table A. 15. 
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' obvious^ ones was whether the pattern of results across the different, 
subsaaples re€lecte'd the 'chtogingi> site conposition of the sample (see ' 
\ . Table ,11 ,2) • However, adjtisting for the varying site conpositions of the 
samples explained little^ of these differences. Other possible explana- * 
tions for vAidh we coiad identic, no enpirical ^si^jport concern extreme^ 
valuegt of the emp lgyaent -' outcome m easxires ind differential nonresponse to 



xntex?views Another potential sourpe of these differences is an inter- 

^— ~^action^berween..the ..sites and local labor-market conditions. Howeve^, 

efforts to ^sentangle the labor-meurket and site influences have been 
'plagued by a combination of the sitoll saitple sizes a^^ the^^mall yariation- 

in labor-market conditions across time relative to the variatiqn across 

' 2/ ' ' _ . 

Sites.— 

, -While we cannot fully explain why these sxibgroips of the youth 

saii$)le behave differently, it is apparent that the long- term.* follow-up 
♦ , • 

' results reported hfere may not be indicative of the overall rastilts that 
" . \ 

would have been observed for the full sample. Fuirthermore, because of 

% . / ' . 

the peculiar pattern of outcome measures across the different analysis 

samples and across different follow-i:p .periods, it is not even -possible 



— We foxand no extreme values for either hours or earnings (e,g.^ 
earnings in excess of $7 per hour an4 hours in excess of ^70 per week) 
(see Table A.10) .J_ , - 

-^^ - . Brown '.(1979) and Appendix B provide evidence to siiggest that 

interview nonresponse'*has hot resulted in. biased estimates of program 
impacts. 

2/ ' • . 

-^We should , remind the reader thc^t the results disctassed above 

are- regi-ession-adjusted, so differences across analysis sairples shotiLd 

not^be due to variations in the measured characteristics of the dif ':erent 

grotjps. (See Table* II. 4.) 

■ ••, . ■ . 104 " / ■ ■ ■ " 

ERIC .. . •* 88 ,^ , ' 



to infer the nature of the ^xgectBd shift in rfesults that would have 
occurzed from months 19 to 2T to months 28 to 36 if all sarople youth 
had >een interviewed at these later periods*-^^ In drawing policy conclu- 
sionS/ therefore, little weight shoiild be given to the results for the 
23- to iff^inonth ^period. , " \ ^ i 



' DIFFERENTIAL IMPACTS 01L.S AMPLE SUBGROfiKS, 



/The. overall sample results, disctissed in the preceding sec'tion 



provide no evidence to suggest that Su^prted Work is successful in its, 

cfoal of improving youth's long-term employment experiences. We may be 

. - - . - - ' ' ' y - 

able to gaiin some insights, as to possible reasons for. this by considering 

2/ 

the extent to which program iiipacts vary across san^Jle stibg^roxjps . 

1. DiffejEgntial Impacts Across Sites • ; 

Table III. 7 presents estimated program iipacts on hours worked 
for each of the five Si^ported Work sites enrolling youth.— " Differen- 
tialh in inpacts during the first nine^ months, when 'all experimental group 



Given that experimental-control 'differentials appear tq be 
strongly related tgfSbntrol behavior rather than ejqperimental, an unsub- 
stantiated judqjtejTOv ii, that the full sample would exhibit smaller enployruent 
jrate and hoursl^ll^rentials and jnofe .positive earnings differentials than • 
those estdroatedKfSi' the 'small subsample ^o cpmpleted a 36 -month interview. 
(Ihe estimated program inpacts for other target groups also suggest- that 
'St:pport|^d Work iftay have sustained inpactjs only .arogyng individuals for whom 
.or during periods when alternative ertploymeht opportunities are extreiSely 
limitsd.) V . . . ' " » 

• Sainple ^izes for the vairiou^ subgrotps cam be determined by 
.multiplying, th^ -proportion iDf "the saji^ple in eadi subgroijpi by the overall* 
sample, size.. /''Tli^se proportions., and sample sizfes are presented in Appendix 
Table A. 4a. *; ' ' ' ♦ • ^ * 

-^^Site iiipacj:s were also estimated using tobit, with similar 
results, except that the 28- to- 36-month differential for the PhiTadelph^ia^ 
-^ampie^is. significant at the/LO percent ,le';el, '(Tobit^ 2s£iinates are ' 
presented in Appendix Table A.16.') * * . 
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.Monthrl 



tjqperiaental* 

' Control 
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Mean 



• ✓ 
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■ 39.7 


11.7** 


* 58.2 
« # 




68,2 




• 

77.1** . 

S7.2** 

94.6** 

41.5** 

46.9** 


M.l 

35.1 
. 45.1 
39.9 
31.1 


5.5 
11.9* 

i •0.2 
22,5* 

' 30.7* 


79,2 
49.7 
73.1. 
61. a, 
30. a 


.15.5^^ 
\ 3.9 

21.^^ 
14.3 


127,9^^ 
62.5 

32.8=' 
45.3 



^iMperiaental* Coiitrol 
Control < Oroyp 
Oifferentiol Hekn 



7.2. 

9.6"' 
-10.5 
n.e. 
35.9 



0174 



-81. l"' 

io;;.7 

n.a. 
44.6 



n : : ^ : : 

HinUi S«« ^»ote to T«l>le III. 3. ffMpleo oltee Cor varlouo eutjtoMpo CMi^.to c*lcul«^d by multiplying the prof>ortloo ot the eeiiple In tlie eubgroi^ by tite 
totel sMpkle slxo. lliese Ylguree ere presented in Ap^ndlx T^ble A. 4. . ^ 

«/ " ' 

-^tlieiie overall eeii|)|e renultn were estlMted itom en etiuatlor, thet did not Includa verlebles Interacting expeilnontel status with site. Itius, 
'the siijgro'up results nay iK)t»>«wel<|ht up to exactly ^tha overall sanple resultii, 

b/ ' . . ' » 

Tikoso data are bosuJ on saiif>le kIms of 20 or less. « 

'ivyperleijii^el-obntrol differentials vary significantly SMOog tIte site** (Section lI.E ddscribee tlie test prooodure.) 

^Statisticaiiy iiifyii f leant at pie 10 percent level. . , ^ 

VSr^tietically si 9»if leant at flte' 5* percent level, ' ^ . 



n.a. » not .afifiU cable 



f • • .... , 

members were eligible to hold program jobs, arfe- dvie almost entirely to i 

variation in the average length of time experimentals spent in Supported 
' • • . 

Wark: in Jersey City,, where ^:he average vie ngth of stay was 8., 2 months, 

ea^jerimentals"' worked 95 hours jnbre per month than controls; in Philadelphia, 

where eoqjerimentals" stayed in the progfanTOTlyTXT leiYtK^ w ^verager " 

experimentals worked only ^7 hoxirsjroore per month than controls. 

" In the svibsequent time periods, as success of experiijpntals^JLn 

nonrprogram'jobs became i^tereasingly more relevant, the pattern of . 

' - / • 

estimated differentials across sites -looks quite different. The point, 

• • ■ * . ^ M- . . . ' . . 

estimates of the e:5)erimental-control differences are always negative 
(though not sicmificantly . different from zero) for^the Jersey City san^Ie, 



and they are alwayii positive for the 'Hartford, New York, and Philadelphia 

samples. Howeve'r/ only the 12-,. 23-, and 31-hoiir differentials estimated 

• * * * * . 

for the the HartJord, NeW York, and Philadelphia samples,, respect?. vely, in 

the 10- to 18-roonth period are s.tatistically significant'.- Unlike^ 'the ^ 

first 9-m6nth period, the differential impacts .in these later periods were 

attributable primarily to the high variance across sites m employment 

among, controls . „For ex^le, in eacU time period, controls in Jersey City 

r \, \' . ' 

worked 25 percen^ mare \han the average for all contrcfSs, While those in ^ 

Philadelphia worked "OiAy 53 to 66 percent as many hotirs per month as the 

•y ^ * . ' ' . 

average for all controls. Esqperimentals' hours also tended to be relatively 

high in. Jersey City and Atlanta and relatively low in the other' three sites. 



* -^Furthermore, the average of the e:5)erimental -control differential 
for' the Hartford, New York, -and Philadelphia' sites was significant only for 
months 1 to 9 and 10 to 18. The estimated program effect was .significantly 
different between those enrolled in Hartford, New York,.- and Philadelphia, 
arid those enrolled in Jersey City or Atlanta only in months 1 to 9: 



• but the*range was considerably, smaller than observed among th,e various 
control grovjfJs. ' ^ - ^ 

Thus^ as in the case of- the differential inpacts anJbng samples 
with different amounts of fo^aow-i?) data, we observe that a. more favorable 
pattern of estd^i^^ prograitTT^acts was^observed'ainong those ?*uth vAio 
*btherwise had o/Sctremely limited e^iti^mept^opportunities, ^as evidenced by ^ 
the controls'' behavior. What is not apparenbs^rom this pattern of results 
is the cause of the relatively low employment among controls\n New York, 
Philadelphia, and, Hartford, .On; the one liand, -the previously noted trends 
in area unemployment rates (see) Figure II. 1) are not consistent with this 
pattern .of employment among comtrols in the yari6u5 sites. The allocation 
of i::ETA employment opportunities for youth (see Table II. 6) , on the' other 
hand, does suggest a relatively lower rate of |ublic-en5)loyment opportunities 
for control youths in New York and ^Philadelphia as compared with those in 
other sites. While 'the controls' reports of CETA en^jloymenr indicate that 
employment in CETA jobs^per se ' contributed relatively little- to the cross- 
site variation in their employment, 17 to 30 percent of tiie controls in 
Atlanta and Jersey City reported having jobs in: the pi±>lic sector.-'^ Also, 
as note(| preyioiisly, differential access to CETA and other public-sector 
employment by experiraentals and- controls who were interviewed 36 months 
after enrollment is related to the pattem^of resxilts observed for the 28- 
to 36-month perio_d, particularly those results pertaining to earnings. 

Other factors that may affect the net impact of Supported Work dn 
the various sites by influencing en?>loyment among e:^erimentals are the 



1/ 

— ^ Appendix Tables ' A. 17 and A'.18 display the percentage of experi- 
mentals and controls with CTTA or WIN jobs and the percentage with CETA, 
WIN, or other government -jobs. 
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Supported Work prpgirams themselves and the Receipt of unemployment con^en- 
sation. As noted in Chapter II, these five Supportfid Work prograuns vary 
along so many dimensions that it was not possible tq.. assess the impact of 



variot:is progreua characteristics on subsequent employment e^eriences of 

1/ 

ejqperimentals or on net progrsun inpacts.^ Estimates of the effect^s^o^f^ 
unemployment con^nsation progrsuns suggest that these prograros', at mos^TN^. 
had the effect of fesijlting in negative observed differentials between 
experimentajs* and controls' hours, when the differential would otherwise 
have been expected to be. zero {e.g., cunong. the Jersey City .semple) , eind 

2/ 

of dan^ning the positiver differentials observed for the New York sample.— 

2* Differential Impacts Among Subqroi:^s of the Youth Sample 

Table III .8 presents estimates of program impacts on ho\irs worked 
foi various siabgroi5)S jLdentified by demographic and background chsuracter- 
istics, in order t:o determine whether focusing* the program on a somewhat 
diffe^nt gzoiip of youth than that represented by this evaluation sample 
would be appropriate^. In general, there is no evidence from this sii^grotp 



1/ ^ 

— Hoi lister et ai. (1979) summau:i::e the restilts of an analysis — 
based' on the 13 Si:5>ported Work programs initially included in the national 
demonstration — or the effects of^TOgram, project^ and^tpervisor character- 
istics on various outcome measiires. They f^nd soine evidence ^at the type 
of work pro jet the type of supervision ,^^d the extent df^'si:5)pozrtive 
services are related to program itopact. /however, as, the authors point out, 
these findings may b*L subject to selection bias. 
^ \ ^ • • ^ 

We considered whether the length of time a site had been operating 
affected the prograun's inpact, but found no significatnt relationship. In 
addition, we considered the possibility that the Manpower Demonstration 
itese^irch Corporation (MDRC) , vrtiich mamages the demonstration, cotild identify 
operational, strengths in various programs that. correlated with the impacts 
on youth, but determined that such strengths -were not evident. 



2/, 



Supporting datd are presented in Appendix Table A. 19. 
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TABLE III. a 



HOURS WOfllCEl) tER Wmtl, 
BY P&lOCftApmC AMU ftACKCHOUNO aiAMCTEMISTICS 



Control' 
DiffccciikUl 



All YoMtli^^ ^ ^ 

Yeats of:A9c 
Under '19 
19 or oldtr 

Sex 

IUc«/(tl>^icity 

WliiU^ Mt HisfiMic 
0lMk^ Mt^Mispaiiic 

Tears of education 
• or less 
9 or «oct ^ 

Tiae since Ust birolled in Sciiool-^ 
Less iban^one >ear 
Ont'to Ciwo yeara 
Nort tban two years 

•easoQ tcft Scfiool-^ 
Cmielled 

jsiUa or in (rouble uiih police 

Wautya n Job 

Otli€r 

Lf^nq SitiMtion at Baseline-^ 
With p«rent<s) 
Mot with parents 



•2,7** 

74.9** 

I 

74.7** 
103.4** 



90.2** 
80.S** 
75.4** 

4 r 
7^.7** 
•0,7** 



71.7** 
••.•** 
•5.2** 



7«.l** 
74.4** 
•4.1** 
•1.9** 

• 

•5.7** 
70.9** 



Control 
Crot^ 
Mean 



Moiittis 10 - IB 



39.7 



a^.4 

41.7 



42.3 
24.0 



3tt.ft 
37.9 
49.4 



3^.3 
40.0 



44.5 

34.0 
37.4 



36.5 
33.4 
45.0 
39.5 



36.1 
40.2 



Experiiiental- 

Control 
OUfereatlsl 



Control 
Croup 
Mean 



Months 19-27 



ExperiKcntel- 

Ccmtrol 
Different isl 



Months 28 - 36 



Control 
Croup 
Mean 



experimental* 

'Control 
Differential 



11 a* 



13-3** 
• .7 



12.6** 
4.0 

• 

54.1** 

• .7 

• .9 



4.1 
12.4** 



20,4** 
10.4 
2.« 



-1.4 
9.3 
IB.O** 
11.9 



11.2* 
11.3 



5B.2 



57.9 
S«.0 



59.7 
44.9 



51 .> 
54.9 
75.9 



Sl.4 

59.1 



57.0 
41.4 
54.3 



57.9 
54.5 
43.0 
56.3 



53.2 
70.0 



0.4 



5.5 
-5.6 



1.9 
-•.2 



-32.1 
2.9 
10.4 



-ia.4 

4.7 



4.2 
-9.1 
5.4 

^ Jl 
-14.9 

21.5 

15.4 
-13.3 

• 

-•.9 

25.0** 



40.2 



40.9 
70.2 



72.2 
34.0 



109.5 
41.3 
77.1 



44.0 
4D.7 



41.5 
76.4 
45.0 



73.4 
42.9 
74.7 
73.0 



72. 
57. 



7.2 



11.5 
-4.4 



52.02/ 



50.42/ 
3.5 , 
-14.42/ 



43.1 

-3.9 



-1.5 
52.0* 
-11.1 

-4.42/ 
15.9 
-•.2 
26.0 



17.5 
-22.3 



Cdiilrol 
Croup 
Mean 



•1.4* 



77.0 
95.7 



•7.4 
47.7 



s/ 



•7.42/ 
•0. 
111. 



.1^ 



55.3 
91.7 



93.3 
50.7 
•9.1 

47.92/ 
93.4 
97.2 
59. • 



70.0 
117.7 



K3 



Kjq>eriMntiii7~ .Control 
Control Cro»n> 
Pif'fcrtPtijil Hon 



one parent ■ • . • .7S.7»* : . 40.2 

tW MrenU 91.3** 37 . • 

Other - - 76.9** 43.9 



ttel fare. MMt rood StM<», Receipt in 
Noiitli frioir to KMrollMn^S/ 



77.4** 40.« 
B5.7*'* 37 

rOcpendtiits 

.hmm ^ 82.3** 

Oiie or wore . 63.6*** "49.1 

HMitUs in UM»9eat Job 

0 . 73.1** 38.9 

1-12 * 81.9** 40.3 

Hore tt«ai» 12 ' W.3** 37.1 

Ueeks tlorked ik tear 

rrlor to CnrolWnt^ 

^- ^ 80. S** 36.4 

5- - ^ 80.4** : 38. 2 

10. ' 80.4** 40.0 

'i * 

Weeks of ^ob Ti'aiiiinci in 

Year frior to,enioll»ent i 

Lets than ^ W.I** 39.6 

aoriMre «9.1** 41.0 

Priof Orug Use ' ^ 

Used dru9« other than aarl J iMua 73.3** 47.4 

Pid i4ot use any dru9 other ih>in v 

Mri)U4n« a2^5** 37.4 

l*rior Mrresta^ 

0 79.0** 42.9 

4* 8S.0** 38.6 

9 79.2** ' 38-9 



J 



ikwthe 10 - If 



Kxperinental* 

Control 
Di^ftrentA'al 



4.4 

22.8** 
9.7 



Control, 
Group 
Hean 



64.6 
50.5 
48.0 



tlontlia 19 ' 27 



.Kvpcriiiefital'' 

Control. 
Differential 

SI ^ 



-0.5 
1.8 

2.2 



Control 
droup 
Mean 



66.0 
66.6 
94.0 
\ 



Hontbs 28-36 



QKpcrijaental- 

.Contrbl;'^ 
DiffeVcntlal 



57S 
13.6 



Control 
' icroup 
Itean 



97;8- 
64.0 
94.5 



7.9 
18.3* 



57.3 
59.1 



6^ 
-11.1 



70.9 
6r.6' 



-6.4 

37.2 



93.0 
'4i .7 



9.4* 
29.4* 



59,7 
42.1 



i 

'r3.1 
42.3* 



33. S 



5.8 ^ 



81.8 

138.1^ 



0.6 
15.7* 
5.4 



56.7 
56.7 
72.8 



-19.1 
10.4 

-23.6 



77.6 

62.3 
90.5 



49.3 
-13.1 ^ 
31.72/ 



39.6 
103.4 
55.8*/ 



15.8** 
13.5** 
11. I** 



51.5 
54.9 
'58.4 



0.2 
0.5 
0.8 



61.6 
64.8 
68.0 



,20.4 
14.2 
8.0 



69.8 
75. 8 
01.9 



9.6* 
26.6* 



59.1 
48.4 



-0.4 
10.7 



68.8 
6?. 2 



8 

10.2 
-78.9* 



75.0 
147.1 



15.5 
10.2* 



47.6 
61.1 



16.3 
-5.8 



57.6 
72.5 ^ 



10.8 
0.4 



84.0 
lf5.8 



17.8* 
8.1 
3.9 



61.0 
57.6 
58.0 



-5.0 
10.8 
9.6 



81.8 

57.2 
58.0 



12.8 
6.7 
4.0 



88.5 
87.0 
91.8 



it, ^ 









4^ 












VTABii il a ;<cbn t iiiued) 




















tkmths 1 - 


9 


Nontlis 10 


- la 


Nontils 19 


- 27 


Months 28^ 


- 36 




CicperiMenUl- 

Control , 
Differential 


Control 
Group 
Heaa 


Experiaenial- 

Control 
' DHferentUl 


Control^ 
« Group 
_ He*« 


. experimental- ^ 
Control^ 
Differential 


Control 
Gioup 
Mean 


SxpcriMcntal- 

Control 
Dififeicntial 


Control ^ 
' - Groiip 


,ltoAtl»'' \Siitce ^iicairceriition 
^teye r i iicarce r« teUf « ^ 
12- or less , 


62.6** 
. 94.^** 


41.6-'^ 

3S,4 

32.0 


13.7** 

T. 9 
-1,9 


60.^ 
43.8 

^ " 62.3 


- ■ g - - - 
m 

12. '4 
^ 12.2 

-26.1* 


62.9 

At \ * 


15.7 
-20,2 


*9i.2 
103. 9; 


4? 
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tikctut »'«iauU^^(erti ot;tiHuited froM aii equation tlidL InclodDd oaly the titanaarvi coiiliol variAhlos aiKl an oxperlmontal-LtAtits Vdrldlap. VXuvi, 
tltu siilit|rotip rnsolts MyiiAL always welt|ht u|> lo tlio&c overall saaplo valuus. ^ * 

li/,' *- \ / • ' * *V 

-^lliose 8uli9rou[) xusiihcfr^wer<i bstinaLoA in bcparate tugresaiuiis Miicli did not ainultanoouoly control foe potential differetx:ou am^tnj tlioso wlUi . 

"otluir'duractori sties. ^ 

*^U«lf44re incl^ktti Al'lX:, General AsBistance. otliur welfare, euid wolfaru iiicond for which respondents could<^not Iditiitify tiie source. 

^ti^se estInattiS«ot sUiQroup effecls aiul mean^ are based on a linear (or piecewiso linear) spnci flcation of the sanfUo charactcristict 
uvaltiaceU ^t the «si>eci f i^d poi nts.- « - 

«/ -' 

-f lliese data are based %\t\ sain|)le sizes of 20 or lesu. * 

« 

I 

£xi)uriiNQnt<il-contn>l d) f furent ials .vaiy significantly ammtj the^e subcjiot^is. (Section It.£ iloscrit^s ibu tost prucndiire.) 

*:«ltitistically siynificant at Ute lU porcent level. 
**SI<%tistlcally sigrtificant at the 5 percent level. 
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^analy.sis that S\?>ported Work will mitigate the employment problems of any 
, Subset of the youth population! The results are no more than suggestive 
that a program of this type may be more success'ful if targeted at :^ounger 



youths r those raised in intact fend lies, those who have one or more 

dependents to sippprt, those vrtio have little or no recjnt'^ork experience, 

and those who have used drugs^ (other than mteirijuana or alcohol) • Each of 

these, subgroups is characterize d^y relatively low employment among control 

group inelnbers, as were the sitas where more positive experimental-control 

/ 

differentials were observed, T^e point estimates of experimental-control 
differentials for these various svtogravqps te'ndjto be ^consistently positive 

and larger than for the overall sampl^, but they are infrequently^signifi- 

• ' 1/ 
caiitly .different from zero, e:^pt for months 1 to 18,- Fxirthermore, 

.the' variance across subgroups in the point estimates of program impacts , 

is sufficiently large .that, generally, we could not conclude that the 
r , ' * » , . . - 

point estimates are significantly different from each other. . 

•Si 

'E. FATT^PNS OP NON-PRDGRAM EMPLOYMENT 

It is possible that while rvot affecting the more obvious measures 
of success— employment 'rates-, hours worksd, and earnings— Svqpported Work 
might favorably inJ^tifence .the pattern of youths' employment or the nature 

""oT^ffieir jobs . Wrther^ an tfxamination-of -the t)on-program employment 
experiences of experimentals and controls might shed some light oa^ the 
3^asons why the program had so little inqpact along these ntain aimfensions . . 



1/ • ' ^ " * * 

We considered the possibility that individuals who had mo^e than 

, one of; the characteristics might constitute an appropriate target group for 

a Supported Work program. While we found no evidence to suggest that 

significant* program effects would be observed for^these subsamples, the^ 

sample sizes for this analysis were generally'^^very small. * 



•Tabie III* 9 presents variotis- -data describing the non-program 

employment eaqperiences of e^qperiraental and control grgup laexnbers for whom 

- - % 

various "'amounts of follow-vjJt data are available. In considering these 
<^ta, it is, important to remember that e3q)eri'mental grovip members spent an 
■average of six to seven months in their first speil of Si:5>port€d .ork (13 
percent returned to the. program one or more times after initial ternp-nation) 
Therefore, the data compare the enpioyment es^eriences^of experimentals a^d 
controlis over different lengths •of time: for those with 13 months of 
foilow-iq? data, the reference jperibd for exp^feriment&ls averaged only 11 
months as eompared^with 18 months for controls; similarly, for the 27-mDnth 
and '36-month follow-ip sauries, thte reference periods for ejcperimentals 
averaged 21 and 28 months, respectively. As a .result of these different 
reference' periods for eaqperimentals and controls, there will be a tendency 
for'e^erimentals' experiences _ to look slightly less favorable than 
conl:rolsS particixlarly^ among the sanqple for whom only 18 months of 
follow-up data were^vailable . ^ ^ c " 

Indeed, vAiat we observe is that the non-program employment experi- 
,ences of the two grotps are quite similar. For all thr6e\san5>les , a 
'slightly lower percentage of eaqperimentals than controls had some non- 
program -job (mainly reflecting their shorter reference period),, and 
e:4>erirDer^aIs wprkedjbnly^^^ of the available 

weeks than, did , controls.—'^ . Among both e35>erimBntals arid controls, two- 
thirds to three-quarters of the^ jobs were in the manufacturing, retail 



-/por experimentals, their available *weeks are cbnsidered to be 
those since their first Stpported Work termination, and for controls, they 
include the full follow-uqp period. 



TABii :ii.9 

NON'SUPJfORTiD-UOIlK eHFtOYHENT SXPCRIOICIC 
YOUTH SJOIPLE 



AO 



SMH)le .Witli 18 HontliK of 



SM^le with 27 Months ol 
Follow-up bati-.* 



Sm^U ytitylb «Mbnl^ 



* F«rcent^ wh Work &ipioy»eht 

Of .Those With lkm*Sii(^rttd tto Kaployaent^ 

'>crc«htS9e who *f oiiod , jo6 through ; 
- yufjport^ Woirk ; / '\ 

EaployMeiit 'Service . , ^ 

P<rccat«ge with rollover jobs-: 

* Pcr'^ent«9e with CETA or WIN jobs 
Percentage with CXth, WIN, or governieM jobs 



iiperliientels Controli EKperi^entels Controls iMpariaentsls Controls? 



65. a 



78.4 



74.8 



7.2 



82.8 



90.3 



93.2 . 



Hours worked p«r week 



£/ 



Hours worked per week when' worked-. 

♦ A/ 
Wage f^r hour (dollars)-' 

Length of first continuous spell of eaployMnt (nonths) 
-Percent iw their first job at end of follow-up period . 

Nui^er of spells of eaploynent 
. PercentTage of available weeks, ettployed 



15.3 ' 
3.1 


• n.a. 
8.3 


10.6 * 
8.7 • 


n.a. 

13.1 


5.4 
7.1 


n.a. 

2r.a V 


3.8 


n.a'. 


2.9 , 


ri.a.^ 


1.8 




9.2 , 


0.8 


11.5 


13.7 


16.1 


lo.4 


23.7 


23.2 


26.0 


29.8 ' 


33. Sf 


50.9 


18.8 


1S.4 


17.4 ^ 


r 14.7 


16rl 


14.6 

* 


39.3 


38.4 


38.8. 


38. a 


35. a 


39.3 


3.44 


3.40. 


,3.76 


3.41 


3.43 


3.59 


3.9 
32.3 


• 26.5 


6.0 
25.0 
1 .7 ♦ 


5.6 -"^ 
* 13.8 


5.8 - 
19.6 


. 4.7 • 

5.5 


1.4 


•1.5 


1.9 


. 2,2 


.2.6 


48.3 


38.9 


43.9 ' ♦ 


36.8 


42.9 ^ 


'38.1 



H^. these data an. ,K>f regression-adjusted. Saiiplis .«ed include only uiose observations for Oto. continuous data for the indicated lengU. of 
. tiae (18, 27, or 36 MxiUts) were available. DaU pertain to the full period «»vered by the interview data. 

■fiWrteen percent of, the .a-ple left the progr«. -ore than once. On averagi:' indiyiduaU were in Supported Work 6.3 months at the ti-e 
^of their first teraination. The overall average length of stay^t.^ »0Hths. - _ 

participant nith a rollover job is one who has the sa^e job as during S.^orted Work participation, bu^ whose wage ii no longer 
Siibbidized by Supported- Work nor does'Uie Supported Work program provide sui>ervi8ion. 

£/Kor e^pe^i-entals. the 'average hours worked per week were calculated for the period since leaving S^^orUd Work. They do not 
*iiiclMde iwn-Supported-Work hours during the period of program participation: , 

^^tX^tle wage rates are calculated as the average, for all individual.* who had jobs, of their- total earning, divided by .t^e .n.»ber ' 
of hours worked. ' * ' * * / 



B 



trade, and service industries, ud^they were xa^inly in* clerical, service, 

1/ - 

and' miscellaneous 'occupations 
^ ^ Arsurprisihgly-^SM^ of the san^le 

• ; . • ' - ' ' • . • ^ ' • 

, reported that the S\:pported Woi^ program or the emplpytnent service had 

. * . • • • • . . ■ 

helped- them find their jobs, and <less t^ian 3 percent of, the ea^riroentals* 

. . % - ^ \ 

aon-program jobs were a continviation of .the^r Svpported Work jobs with a 

Shinto alternative, fimding amd s\?)ervision (i»e., rollover jobs)\ The 

percentage ^of e35>eriinental youth who reported that the .Sipported Work program 

had. helped them find a hon-^ro^rzun job increeised over time, from 3^ percent of 

those enrolled ir\^ 1975 to 7 percent of those enrolled in 1977. Also, youtl> 

in Hartford emd Atlamta'-were much more likely to report, program assistance 

• "P^ ' ; 

(9 and 8 -percent, • respectively) thaca those in the other sites (les^ than 

5 percent , in Jersey'. City amd New York emd none in Philadelphia) . 

, CETA jobs were much less prevalent among both qroxsps than we had 

anticipated they might be, and there was little difference in the preva- 

lence of such jobs between eaqperimentals and cont*rols who were employed. 

Between 9 and 16 percent of the different sxilpsanples reported such jobs. 

However> two ^factors are noteworthy: the first is that the average income<jj^ 

2/ 

from CETA enployment increased over calendar time,--* amd the second is that 

CETA enploym^nt tended to be more* pre vadent junong the Jersey City controls # 

- , ■ « 

than auQong controls in other sites or than among experimentals in this site« 
(These facts may partially es^lain the relatively high enployment among 
controls in the 28- to 36-month period, which on average is 3 months later 



1/ . 

. "^6? i^pendix TaQ^les A. 20. and^A.21. 

' .< '^Foi^ex£tmple,» for the full sampie, CETA earnings during' late 197^f 
and early. 1977 averaged about $5* pea; month; during late 1977 the average 
was- $iD per month; and during late 1976 it was -about §17 per month. 



'ian .the calendar time'.covered'by the 19-" to 27-inonth results, and which 



includes a ^sarnple of. which ,56 percent are from./e^sey Co^^y.) ' , 

.In terms of other aspects. of the fion-prograin jobs, thete are ntf , 
noteworthy differences. Anong thoae v^o were enployed, the average hours^ ' 



worked per week when'ecplpyed was 36 to 39, suggesting thae nearly all 
worked at^full-tiiine jobs.. Experiitentalp .worked slightly more hours per\^ - 

month than cpnt?x>ls; but for the fxill youth sal*:.- ^e, the average hours 

> \. • ' . > • . 

worked in non-pttogram jobs per "available" month was^; about the same .for " 

i> • . / . • 

* » ' * . , /» ^ • » 

both'gnoi?)s (11 to 15-).. Ave^age^'hourly wage rates varied between experi- 
aeritals and^cqntrols by 5 to *10 percent in either direction. Among the 
i^-oohtli .^ample, experirentd^^s exhibited a tendency toward more stable 
emplojff at— the average length of their fiirst non-program job being 6 . 
jnonths, as compared with 5 months for contr6Ts* (not accoxmtihg for the fact 
that a .higher percentage of this gxpi?> 'than of controls were* still in that 

\ ' \ . , . . * 1/ ' 

'.first jobVt the time of theix final, interview— 20 versus 6 pe.rcent) .-^ 

As we^noted in the discxission of experimentals' Si^Jported Work ' 
esqjeriences, youth tended to st^y in Si^pqrted Work longer than they 
stayed. in other types\of jobs (6:7 months, as compared with 5 to 6 TOnths 
for non-program jobs)'.-^^ Yet, neither. for Supported Work jobs nor fqrr. 



i^Of those- youth.- who left their non-program jobs, 30 to 40 per- 
cent exj^ressed dissatisfaction with the- job.:. Half of^the experimentals 
and 36..percent of the controls/reported having "lefj: due to laok of work* 
Ten per.cent of the.ei^,erimentais and 6' percent of the controls lef" ^or 
a^ better opportunitiy (see Appendix Tabl^ A. 22) . 

•^While the data irt Table III. 9 indicate that an average spell of 
enployment among controls lasted -between 4.7 and 5.6 mohths, recall that 
soQie contrpp.s were still in their^ first job at the end o.f the period • 
covered fay^'the interview data. . * 



non-prograic jobs has longer tenxure been found to result in inprovements in 

other dimensions of eraployinent- related outc»roe§* such as en5)loyin8nt rates 

*t * ' * 

or levels . * 



F. IMPACTS ON EMPLOYMENT STATUS AND JOB SEARCH. 

In addition to .-directly altering employment opportuni-tiys— for^ 



youth, it was expected that Supported Work might .increase youths' partici- 
paltion in th4 labor force and eater the extent and nature of their job- 
search arti,vity- However, except for the first nine months following 
enrollment, when a significantly higher percentage of e3?>efimentals than 
controls were enployed in Si^jported Work and so not actively engaged in 
job search there was little difference in either the .labor- force"* status 
or job-^search activity of the two groups.- After month 9, between half 
and three-quarters of these youth were in the labor force during a giveji 
month, and about half qf those in the l2UDor force were employed. Those 
looking for work spent an "average of about eight hours per week'^n search 



activities,, which included an average of five to six contacts with 

'1/ * ' 

employers.-^ Less than half the youth looking for work reported checking 

with the state eaployment service -and only a few (3'to 14 percent) checked 

with the CETA office. Most jefforts appeared to have invol^ved less formal 

search methods such'^s contacting friends, looking in 'the newspaper, and 

checking with employers directly. 

We do observe a consistent pattern of higher reservation wage. 

2/ * ' 

ratC5-^ among experxmentals, which are between $5 and $15 per week (4 to 



-^The above d».ta refer- to ^job-search activity during the four 
weeks preceding each follow-tp interview (see Appendix Table* A. 23) . 

2/ ' • . V * 

-%The,jre^ervati6f^wage rate is the lowe^ wage for which the 
vidua! is willing vto wptk*^^ / - 



14i percent) higher than anong controls ••^'^ It is possible, then, that this 
hi^er researvatxon wage among experiaentals has led to the discouraging 
.results with respect to job*search efforts, which resulted in both lower 
enploynibnt rates and reduced labor-force participation than would other- 

wise',havp .beeajeaqpected^ HQWfi3flar,_we^have^not_undertakea a formal^ test of 

this notion. 



This lack of prograun inpact on job search suggests that there will 

' .. : ^ 

not. be en^loynent effects in later time periods than covered by our data' 
which are attributable to program-induced changes in job-seaurch activity. 



G. IMPACTS ON EDUCATION AND TRAINING 

Limited education and formal training are often cited as oYie of 
the main reasons for the es^loyment problems of youth. While the Supported 
Work program itself enqphasizes the provision of work e:q>erience rather than 
■ formal tradni^ig, there are reaaons to e:<pect that it might nonetheless 
affect the education auid training decisions of participants and former 
participants. On the one hand,. Supported Work might increase participation 



,-^This pattern of differentials between e^^erimentals* duid controls 
reservation' wage rates does -not appear to be related to differentials -in 
unen^loyment oonpensation receipt (see Table IV. la emd Appendix Table A. 23) 

2/ ' • ' * * * 

^ Employed controls consistently had higher average reservation 

wage rates than '^s^erimentals and than the unenpioyed or nonparticipants 

in the labor force. This suggests that more es^rimentals ^probably could 

have foxuid vodc than did so, but at lower wage rates thain the. average com** 

manded by those v^o Had found esployment. ' 

While the differences were not statistically significant, a 
substantially higher percentage of e^qperimsntals than controls reported 
that ttiey had not 'undertaken any formal job search dtiring the 10- to 18- 
month period (14 versus 10 percent) and the 19- to 27-mohth period (16 
versus- 10 percent) because they felt that they would not be able to find 
work. 



10 



in such progr2uns by altering attitudes towards,, providing infontation 

abbutv .or providing an income soxirce to siqpport investments in human 

capital* On*the other hand, ^the program may tend to limit such invest- 

»0nts by direcitly increasing employment opportvinities , paurticularly in;, 

the short-run, and consequently the opportunity costs of such investments. 
' r. , .... 

>As can.. be seen from Teible III. 10, Supported Work tended to reduce 
.9li^tly aULtemative investments in human capital during the first 18 
months following enrollment (particularly vAiile experimental giroup members 
were p2urticipating in Supported Work) , but; not thereafter. However, 
edbcation and treu^ning by both groups' was quite limited throughout the 
foUow-tjp period: 6 to i6 percent were enrolled iri education programs 
^ (mainly high school) during any 9-month period, and less than 10 percent 
were in formal training programs (a third ^ less of which were sponsored 
by CETA) i 

CONCLUSIONS 

The weight of the evidence suggests that Supported Work is not an 
effective means of mitigating the employment problems faced by youth. 
Youth stayed in Si?>ported Work jobs for considerably shorter periods of 
^-^m^ than permitted under program regulations, yet less than 20 percent 
of ',them left to take another job. Over 40 percent left, indeed, for 
negative reasons. At some time siabsequent to leaving Supported Wozk, most 
of xhB youth in the eiqperimental groiip did find non-program employment: 
about 30 percent did so within the first month after leaving, and two-thirds 
had done so within one year of leaving. However, what we also observe is 
that many of these ^outh would have .been similarly successful in finding 
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0.9 


10.1 
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'Ave rage ^^immI^ vt^ks 


-1.3** 


2.9 
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-0.1 


1.8 


-0.1 


1.8' ' 


-0.8 


i.7 \ 




oV tUofj?, participatinqr(.' 

i'ercebtaf^ in bigh^scbGlol pro^ra* 
Percentage iu vocational program^ 
Pcrcehtage iti col lege , pro^raa 

^liercehtage in other prograM ^ 


1.4 
-4.7 

1.5 


68.9 
15.6 
-8.9 
6.7 


•10.8 
8.1 
-5.4 
8.1 


75.7 
^ 10.8 
13.5 
0.0 


10.0 
1.7 
•21 ."7 
10.0 


60.0 
13 .3 
26.7 

Ut.U 


0.0 
^ , 0.0 
16.7 


'sp.p 

a - A 

' u « o, 
33.3 
16.7 




Pe&'ceutage receiving diploM or 
atijree*' 

^ Ti aiaiiig Progi aMS 


Q-1 


1.2 


-0.6 


2.0 


1.4 


0.8 


•2.6 . 


2.6 




Percentage participating 


-3.7** 


7.2 


-4.0** 


9.6 


-0.2 


5.7 


^ -0.5 


'4"; 2' ' 




Avtirage ninber of weeks 


-0.6** 


1.1 


-0.7* 


1.6 


-0.2. 
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;bl6 




Oi lhose.p4rticipating. p«rcentdge 
* iit progi'ans. sponsored by- 
:iiH)ported Work 
irm or WIN 
iail or prison 
iUlier 


33.3** 
•13.3 • 

-6.7 
-13.3 


0.0 
26.7 
13^3 
60.0 


0.0 
2.2 
-17.7* 
15.5 


0.0 
34.1 
26.8 
39.0 ^ 


0.0 

21.4 ^ 
/ -14.3 
-7.1 


0.0 
21.4 

35.7 , 
42,9 


-i^o.o 

-33.3 . 
0.0 
33.3 


. 0.0 
33.3 
33.3 
33.3 




Pet'centaqe receiving certificate-^ 


<.-1.0' 


2.5 


-4.3** 


5.8 


0.7 


2.2 


-2.6 


-2.6 



HOTU:- See note to Table III. 3. »inle«8 otiierwise noted, data |>ertain to the full 3dni>lo. 
^Tlwse data are not regre:i:iion-ad justed.^ 

'^'tlmao figures may include tiK>stt for vocational high school programii. 



t •Statistically significant at Uiu 10 percent levji^l. 
O •Statistically significant at Uio 5 percent level. 
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not part^ Work^ as eyidanced by 

:tM •jnpioyi^ !3P^^t I^^M i^tes, while 'much lower 

ttyui. the average for all yoiith/^ an higher than, for other Sijpported Work 
jargetT^gro and th^^ fer tili^ siibg^ of youth, oh whom 

Supported Work focused. The analysis of dlfferehtiai Impacts across sites 

sub^iqps of youth shoif/ A :c»n (though generally not significant) 

. ./^ ; • • - \ . , \^ ^ ' / V • ' . • , 

:patterxi.:Of relatively more fevq»fale^prbgram effects among thpse youth 
iAose< cpnt^l :gi^ <»wtfe2^4u:ts e unusually lew levels of employ 

mentr the earliest enroliees^ the demonstration; , thos^i in New* York, 
Rai:tfbrd^ and Philadelphia;, and those who are younger, have one bt more 
dependents, were x^sid by tm parents, and have little or ijo recent 
' employmtnt experience and soma history of drugs. However, the results 
provide no- strong evidence to suggest that sijsiply redirecting Supported 
Work to fbcx2S on this subset of .youth would substantially alter the conclu*- 
sions concerning its succes i in its primary .objective of iit?)roving youth's 
long-term, employment prosp^bts^ 

The program cleaurly fees have short-term benefits in terms of 
increasing the en?)lo'yment opport^nitie^/or this segment of the population. 
However, in judging whether thes^\ immediate benefits can justify the 
continxi^^bh of Supported.Work ^programs for youth, one must give careful 
.consideration to its cost*effectiVehe^ in relation to alternative ^ 



^'^^See Kemper, Thornton,- and Loilg (1980) for a detailed discussion 
p£ the costs of S imported Work, the value of its benefits, and the relation- 
ship between, the costs Md^^^ of Supported Work and those of alternative 
Memploymeut . progrMas . ' . ' 



- CHAP.IER IV 

. . • . , : : ' . . ■• -.-.^ 

DICOME, IN-KIND TRANSFERS, AND RELATED, OUTCOMES 

, J ■ " I ' _ 

One rationale for pjibiic eaqpenditures on en4>loynenf and 
traii^g, programs £p^ youth is that they will increaise the economic - 
statuit^jfmd indepen^ience of the i>art both while they are 

enrolled the prograa and sub^ Dvirijig the month prior 

taeriTOlia^ exhibited a very, 

low level of income- (about $100) , 35 percent of which came f^om ^ 
public; assistance. In idiis chap^^^ we consider the short- and 
longer f\m impacts of Sipported Work on the total income received 
by participant^ and the sbitces of this income. In addition to 
l^ihg^ concerned with overall econoniic status, we are interest^ad 
in t)ie ejctent to vdiich individuals become relatively more dependent 
on earnings and less so on transfer income and various -forms of 
in-kind assistance,^ and the extent to which programrinduced changes 
in earnings and other sourpes; pf incolne might lead to signif icant 
changes in other areas, such* as household coiqposition,^ expenditures 
for housing, and medical-care' ^ 



1/ • • • 

i.vT< ^ptiring each 9-month ptsriod, 3 to 17 percenj: of the 
ejqperimentai. and control youtdx report receiving soiak wney through 
iilegial^a^^ iseUing <^ HoWyer, because . 

the :dataL^. a^^ vaccurai^,^ ^^^^^ differentials 

betwe% eaqper^^^ small, auid iecause . 

the arount MMyil ;3celati6n to ihcome from .other 

spiMTces (ies* thim^;^^^ We h*yi; h^^^^ illegal activities 

^ambng the sources of ihcome. cpnsider^^^ in^ thiis* ^chapter . 



In thejnext^ itectdoh we discuss the effect of Supported Work 
oh receipt each of fiye different sources: earnings, 

unes^ioyment cGoq^ensatipn, welfare ir food stan^ bonuses, and other 

...... " ' ^ I 

' -^Z . ' ' — 

programs or persons.-' . Siibsequently, we consider changes in receipt 

of in-*kiiid bc^ These varioui^ sources of income amd in-kind 

ik^nefits rare depicted' in Figure l^^ The third section discusses ' 

results for a variety of putcqnes related to economic well'-being. 

A. PlUXfW^ EFFECT^^ 

With the exception of the first .nine ^months after enrollment 
when, as a result of their Supported Work jobs, experimentals had 
siibstantially higher earnings than*lcontrols, program islets on 
both toteU. income and its sources were modest and generally not 
significantly different from zero. As seen from "Table IV* 1, during 



the first 18 months following enrollment, experimentals were more 
likely than coAtrols to b^^enployed (mainly ixC Supported Work jobs) 
2uid their resulting higher earnings led to significant reductions 



" ^ Since 65 percent of * the , saxaple youth lived with theiV 
parents at-^e. time of fuirollaiient in the jdemohstratioA, we might 
e:q>ect the yotxth/'s ihc^^ g2djis to peurticularly influence the 

.trams^er income receive^ by ot^er* household members • -^The only 
evidence we 'have ojE -such kn effect, however, is a reported six- 
point reducticm the percentu^ge of' e:^ relative to 
con^JTolSr wh6 report:ed that other household members? received any 

.fom of public 'assistance f Irst 9 mcfnths following 

enrollment; This resist does^ hot persist into subsequent periods; 
furthermore, it may conf ouuided with trends over time^in the' 
numbers; of youth who eure: living .with- their parents. 
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TABU IV. 14 

PEkCENTACE J^qiVlMSTSN^^P^ VMt|OUS~^SOUIiC£S 
^ ^OOTH SAMFU 



liotiths 1 



hi: 



ExperiMcntal*- 

\Cpittroi 
DiflcigutUl 



Control 
Group. 



^- ' -Month* jO - 18 - 

SxperiaA^nCTAl-' Control^ 

Control I ^ Group 
Differential H««h * 



HonClu 19 - 27> 



M<H4ths 2a - 36 



'ExperiMcntil-' 
Control < 
DiffcrcntUr 



"Control 
Group 
. Mean^~ 



-ExperitM:tttal«* 

^Control* 
Oif ierentral 



-Controls 
tiroiip ' 



'CaruiiHis ^ 
-Unearned' liiCQ 



4ii;6M 



^ Uii^loViint > Coajpensii ion -2.0 
M^iUri^^ -6.8** 
>««Ml:SC«iips 



52.5 

4.0 

17.0 
32.4 
6.3 



6.2* 

6.8** 
-3.5 
-3.7 
-1.1 



62.7 

:;.7 

21.4 

30.5 
5.1 



0.0 

3.8* 
-1.3 
-0.6 

0,4 ' 



62.6 

'3.8 
20.6 
29.0 

3,1 



-S,6 
-11.4* 
' 6.6 
0.7 



66.2 

f6.8 
25.0 
30.3 

a. 7 




' ^ TA8LK IV. lb ^ 

IHCOHC RECEIVED PER MONTH F80H VARIOUS SOURCES 

YOUTH SAHFtE 
4! (dolUrs) 



-Coiitrol ^ 
Diffeiential 



control 
Group 
Mean 



All Sources / 21S.01** 176.04 

Eatuings^ ;i2fc.73** 123.95 

Une^rniiil Income 
Ui»aiiployMent Compensation -2.99^ « 5.63 

W.lfare'^' ^ -*».66**n^ 22.85 

Fi>o<l St^aMpg 0.80 17.52 

OilMsri:/ 0;94 5.65 



Months 10 


- 18 


Months 19 


- 27 


Months 28 - 


36 


Experi»ental- 
' . Control 
Differential 


Control 
Group 

he^n 


Experifiental- 

Control 
Differential 


Control 
Group 
Mean 


EKperiaental- 

Control ^ 
Differential 


.Control ^ 
Group 
Mean 


21.95 


265.44 


26.99 


/311.68 


-54 .-54 


408.01 


30.71 


20b. 25 


• 19.30 


248.98 


-41.53 


342.58 

• 


11.16** 
-12.49** 
-3.63* 

-^Z^M^ 


4.71 
33.00 
15.44 

6.ai - 


10.14** 

-6.20 - 
0 -1.42 

SJ^l 


' 5.80'' 
37.30 
16.82 

. 2.42 


-8.16 
-15.75 
5.18 
- - 5.33 


10.25 
36.01 
18.78 
0.58 



rnvkii 5>ee note to Table III. 3. All data pertain to tlie fu^l safl()l6» not oitly to recipients. * ' . 

^Earnifigs d«ca reported in this chapter vary soMwhat fro« those reported in Chapter III, becaitofTof a sligTit difference in tjlje saeples usedi 
onl/ individuals who Itave ^alid ddta ^or all incoimi. sources listed in U»is table were included in the analysis- reported hero. 
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tieifartt includes APDC, ^]^, ^SSl, and other welfare incoee for which jrespondiints were .unable to identify the source. 
^Otlier unearned it>co«d it»cludas Social Security, Pensions, alinony, cliild support, and job-training incoM. 



j^R {(]]*Siati8tic4illy significant at fch« 10 percent level, 
ma^to •Statistically significaiit at the percent level. 
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pijJblic^aaii stance behefi^^ was* largely offset by a significant $11 - 
per noilth .increase in unenpioynent compensation (UC)' among experim^Wls 
relatxve^' to co^rols.-^- By months 19 to 2^ the only, significant « % 
dif£erentdal»iw^ in the piercentages receiving and the average value ^ 
of UC benefits. However/* these differences are relatively small 
(4 percentage points and $iO per laonth, respectively) and,, as noted • 



previously/ they are concentrated, among the Jersey City sample. 

'During^ months 28 to '36, the overall effects indicate a curious 
pattern pf increased en^IoymCnt/ decreased reliance on tremsfer • 
I^grams, and an overall reduction in total income -(due to lower - 
earnings) among experimentals relative to controls. However, the 

. only differential that is statistically significant, is th^ 11 

o - :Ji-.^-2l 



For a subset- of. the S\q?ported Wdrk AFDC sample, interview 
'data on welfare receipt were conqpared with welfare agency 'data. It 
was found that interview data understated by a sm2LLl amount actual ' 
receipts and that the degree of misreporting was strongly related to 
changai in receipt./ For the AFpC sample, it was estimated that mis- 
reporting may have led to as much as a 12 p^rcent^^rror in the 
XMults (Kerachsky et al., 1979). However, because' ^f^ youth's lower' 
receipt rate and incidence' of changes - in receipt, the likely effect 
of misreporting for them is very sioall. 

2/' ^ ' ' 1^'- • 

, ^ On average, females received two to tliree times as much • 
income* from welfare and food staiip bonuses as did males and, consequently, 
program inspects tended- to be substantially higher ^or them since iit^cts' 
wwre strongly rel^'e^^ levels. Amon^'a number 

of otiier senile -subgroiqps for. whom progtam intact s were estimated, there 

was no consistent pattern of differential effects. 

• • . ; • Y 

3/ 

This^uC differential occurred mainly among the Jersey City, 
•sample, in which 40 percent of v the experimentals yersus 8 percent of 
the controls received benefits • 



parcihtage-polnt red)iction in receipt of. any welfare benefits. ^ 

~ r The lirends ixi tot^ ihcbsie and income, scuifces of the entire 
^ •% ^ * 

saffple.are depicted in Figure IV«2^« Except for the sharp increase' 

' ' ' - / ^ * ' . ' ^ a ' 

in e^qpefimentals* incone during their 'participation in « Supported Work, 

^ ' ■ ' \ • 

experiniMtal and control youth experienced roughly similar increaises 

In their^total incomes over time (from abou£ $120 per month prior to 

* ' • • • * 

enrollment to between^ $350 and $^00" per month duri:(ig the third year 
following their program enrollment}^ This'^trend is attributable almost 
entirely to a general increase in employment' and earnings , which ; in 
the long nan/ does not appear to be significantly ^ffected by Suppbi^ted 

W6rk« In no instance during the post-enrollment period did welfare 

\ 

a^d food stamp bonuses^ constit'ute as much as 25 percent of total 

income' and, by months 28 to. 36^ only about 15 percent of al^ incbme 

' ' - 't ■ * 

was uneam^d,"^^ * • ' 

B. RECEIPT OF 'iN-KINTD ASSISTANCE : c . * • 

In* addition to 't^ransfer income, 19 to 21 percent of the sainple 

youth had Medicaid- caurds and 25 to 30 percent receiv^ some form of 

2/ ^ 

housijjg assistance during eac^ of the 9-iDonth follow-up periods*-^ 



*— There was some slight variance 'in dependence on transfer 
income across sites'. Overall, ;^outh in New York were less likely than 
average to. receive benefits (and, consequently, program impacts on ^ 
benefits were^ lower) , and those in Hartford were slightly more likely 
than averaae to receive benefits (and, consequently, pirc^gram impacts on 
benefit l^els were laurger than average) • / Perhaps because welfaure and- 
food st4^s constituted such* a small percentage of total income, we. \ 
obsejn^d no relationship between t^e sites wh^re welfaure a^d^where .employment 
ixnpacts tended 'to relatively more favorable* 



y 



Data on in-kind assistance are presented' in Appendix Table' A. 24* 
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will le ^pro-gram- induced income dianges mL<^t be ejqpected to. alter eligibility 
for both types of benefit's , the dnly significant findings with respect to • 
Medicaid benefits were 6- and "9-point reductions in the percentage of 
experixnentals^t relative to controls who had a Medicaid card during the first, 
md s^econd ^9-mpnth periods af€er"enrolli»nt, respecttLvely. There is some 
indication that card holdership ^remained' lower among ej^perimentals . than 
controls in later periods a,§, well, but tiie^stimated e35)erimBntal-control 
differentials were tot statistically significant • Ihere is, however, no 
indic^tiBn. tihat this'* loss In benefits led to any reduction in public 
expenditures' for subsidized care, as tioth experiroantads and controls 

reported roughly eqtial numbers of subsidized doctor visits- ind subsidized 

1/ ' ^ ' 

days of hospite^l* care - , 

♦ » » • 

Throughout .the period of obs.ervation, a smatlle? percentage of 

experimentals than controls lived in public housing, and those experimentals 

in public housing tended to pay slightly' higher rents than did their rj^ncrol 

group counterparts /however, the ea^e'rimental-control differentials were 

generally small (5 'to 7 percentage points, or $2 to $19) and statistically 

signifi<:ant only during the first 9-month period following enrollment. 

C. OTHER RELATED OUTCOME* MEASURES ' ^ 

^ To the extent that S\?>ported Work is success fta in its primary 
goal of enabling school dropouts, many of \(Aon have some record of criminal, 
activity, to become active members of the workforce and to increase their 
economic status, we mig^t also e^qpe.ct to see changes in areas- such as 



• 1/ ' * 

-^Furchermore, the loss of medical-assistance benefits did not restilt 

in differential consvatption of medical cafe between experimentals and/controls. 
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hotts^old ocoposltlon^ •sqptnditurts for housing^ and merdical^care utiliza* 

r 

tioti of participants and fbrmr participants* Otfaar social prognuns^ such 

tha nagativa inoom tax (HIT) esqparimnts.and Job Corps ^ hava^ shown soina 

1/ 

avidanca of iapacts in tbasa araar*-^ 

With raspapt to housing consumption^ tha ona consistant finding is 
that a his^r parcantaga of as^arioantals than* controls wars ranting non*» 
si:i)sidizad units (^1 varstis 54 to 57 parcant) . HOwavar, thasa differancas 
vara atatis,^i^ally ai^iificant only for tha first 9-8ionth pariod. Es^ri- 
laantals and controls living in thasa nonsiidsi.dizad dwellings paid similar 
rants of about $145 par month. Asi notad previously^ there was some tendency 
for fewer exparimentals than controls to live in public hbusing^ but the 
differentials were not latrga (5 to 7 percentaLge points) and were statis- 
tically significant only during the first 9 months following enrollment. 
During the 19- to 36-month period^ esqperimentals lived in significantly 
larger dwelling units than did controls, but the i^snber of rooms per person 

in the housf^old wa^^^milaf for esqperimentals and controls in all time 

2/ ' ^ 

periods.-^ Residential mobility, tlie incidence of home iiqprovements, and 

crime victimization were sisiilar between es^rimentals and controls 

throughout the period of observation. Similarly, Sii)ported Work does not 

seem to have had much effect on the household conposition of the youth 



1/ : 

-^Khudsan at al. (19(77) and H^nnan (1977) discuss marital-stability 
findings; Wooldridsa (1977)^ Avrin (1978) , and Ohls (1979) discusa housing 
*is|pactf>; and Kerachsky (1977) discusses health-care consumption results 
from the NIT exparimants. Abt Assocdatas (1979) discuss the related impacts 
of the Job Corps program. | p ^ 

' 2/ i 

On average, this sample lived in dwallings with an average of 
1*3 t& 1.5 rooms per person! which is well above national standards for 
'Overcrowding (Hailbnm, 1973) . 
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sasqple. Household size ranged from four to five persons /-^'^ including am 
average of only 0-2 to 0,4 dependents..^ Between 5 and 9 percent of the 
i sasple 'members reported being married in any 9-*month period, but agaiin 
there vais no significant differential between e^^erimentals and controls. 

Finally Sijpported Work had no signif icant^f feet on the use of 

♦ 

health car^ by this ^saople . l^e saiqple averaged roughly one doctor visit 
and one d^y- in the hospital in eadi 9-month period.^ There seemed to be 
no relatiohship between health-care -utilization and eligibility for Medi- 
caid. Among the subsanple of workers, both experimentails and controls lost 
an average of one day's work per month due to illness^" over the^ntire 36 
months. 

D.'^ CONCLUSION 
t 

A Supported Work prograun for youth will have short-term benefits 
to paurticipants In terms of substantially higher standards of living while 
they are in the program. 'For exanple,- eunong, those youth not living with 



— During the last 9-month period (months 28 to 36) the average 
experimental household size .was five, while the control average was four, 
a statistically significant difference. 

Over time, household size tended to decrease, largely as a 
result of youth moving out of their parents* homes: while about 70 percent 
lived with their parents at enrollment, only 56 percent' did so two yea^s 
later. ^ 

3/ * V 

^ Hourly 30 percent of the sample reported having seen a doctor 
and 10 percent reported having been hospitalized during each 9-roonth 
period. . There was very little in the way of consistent experimental- 
control patterns in the reasons for seeking health care, except that in 
the first 18-month period significantly more experimentals than controls 
said. they had visited the doctor as a consequence of job-related injuries. 
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P*i?^.r^ts,. the percentage with incomes below the poverty level was 35 
points lower among the experimental's than the controls. Such changes 'in 
ihcone are* acconpemied by some small benefits to taxpayers in the form of 
reduced transfer payments. However, after youth have left Supported Work, 
the impacts on both personal incomes and public subsidies will.be small, 
at best. Over ♦the first two years following enrollment in Si5)ported Work, 
the net income' gain per participant was almost $2,300, about $1,900 of, 
v*iich they received during the first 9 months. The net reduction in-publicr:^ 
assistance benefits '(welfare and food stamps) totaled less than $300,— 
while unemploynjent conpensation benefits (mainly from the Special Unenploy- 
ment Assistance program) increased by about, $130. Inpacts on other forms 
of transfers were similarly small. We are^left with little reason to 
e^qpect a Supported V7ork program for youth to affect: substantially either 
the oyeradl economic welfare of this segment of the population or its 
demands on our public-assistance programs. Furthermore, there is little 
evidence of any significant changes in the various other outcones considered, 
s^h as household con^josition, housing quality, and medicalncare utilization. 



1^ \ 

4 



•^These estimated effects' are 4 ^to 5 percent smaller if expres^^d 
in constant third-quarter 1976 dDllars. 



• ; . ,iraPACTS 'ON :DRqG USE' 

/ ^'tee ; njati9^ the 1960s^ ' 

continued; into the. mid^-iSJOs^ particulAri\L^euiwh^^ (DuPont> 1978 ) . 

It\wM es;^^^ in 1977, 70 perqent^^of ^ali those age 18-25 were 

.using alcohdl, 30 percent mariju^ and adiaost 4 percent drugs such as 
heroin.r other opiate cocaine, anpheitaiu^ stiimilemts (Abelson et 

al../ 1977),., F^urther, drug ude has . generally been^^oxma, to oe. Higher aiKm"^ 



youth in urban areeu^, those who ate uneapl.oye~d7r"and- those vAio. have^lower 
levels of Education (O'^Donnell et ad., 1976) — chetracteristics that also 
describe the Sipported Work youth sample . The concern over these rising 
trends stems, in paurt, from recognition that drug use ihay exacerbate 

I 

youth's en^loyment problems and that it may lead to increased participation 
in crime (O'Donnell et al., 1976,; Trice and Roman, 1975; Voss, 1976; 
Jessor, 1976) • Howeve^Cj^ there are' also other causes for this coapem, 
including the impact of drug use on health status and productivity, aiiH 
the social costs: incurred^ for treatment and prevention. 

As noted in Chapter II, both sociological and economic theories 
of the causes of drug abuse suggest that S\:pported Work may affect the 
prevalence of drug use. But the dir;ection of the effect is not clear, 
particularly .i^i view of the fact that, contrary to expectations, the youth* 

'in the Supported Work sample di|d not have an xinusually high prevalence of 

* ' , ^1/ 

drug tase prior to their enrollinent in Supported Work (see. Table V*l)\— • 

The one exception i's their spoewhat higher than average use of heroin. 

— ^ — , • . . . % 

'1/ * ' ^ * * 

-/All three sets of data on lifetime use are based on personal 

ihteryi,<ftw responses*. Thus, there is little ^reason 'to expecr that there 

"iras dif'^ewht^^ ^ ^ ^ ^ 



.-.jLlitTijE DTOG SUPPORTED W.ORK 



;Per6Bntige . Repbrtiihg: Ever Having .Used Drug 

>Svpi»3rtad ;Wo A "NataJonal Siutp Natiohar Sample of . 

■ VSMpiea./ " izd-Year-oicisfe^ 18- to aS-Year^blds^ 





/ Alcohol 


- ■72.. 


- 95 - 


84 


T ^ ^ ■ 




61 . 


59 ' ■ 


60 




Cocaine 




16 . 


19 




— ^^Hejgpin J . 


8 


4 


V 




' / Otiier Opiaites 


— ~ 

• 2 


• 33 


^ "~ 14 




Axnphetamines 


7 


• ; ? ■ 26 . 


21 




Barbiturates , 


•8- . 


' ■ 23 


18 


>r • 


Psyched^ics 


10 


30 . 


20 



--^.These data were obtained from ^enrollment interviews and apply 
tioaliV. youth in the Stpported Work * research "^sample (Jackson et al^,. 

^ b/ " • ' 

These data are based on J.n-person interviews with" a san?)Le of 

2?p aOTyeaurroids,^ and 1975 as part of a study of non- 

linedicai lise of 'psychoactive drugs by youog'^men in the United States. 

^riif overall :sa^ tie stu a multi-staged stratified random 

simple^ (si^^^ et; alv/ 1976) . . . . ' * 

c/ : . '-'-"V ■ ^ ' ■ 

r- '!iliese data are based oh interviews with a national saxtple of 
i>500 *i8--fi;d 25rVear-o^^ conducted in 1977 as part of"^ iiationwide y 
survey of p^ef sons; age/ 12 and older living in households ia the contiguous- 
United States (see/Abelsbn et ai.,''1977). 
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Below,- we examine, the evidence concerning Stjppo.rted Work's effect 
on drug- iise in the youth gro\^» , Since use atlcohol and marijuana is 

.particularly prevalent among youth in this sainple and since heroin and 

* . . >■ ' ' . 

* . ' ^ ^ 1/ 

coc«d.ne, use are thought to have serious sdcial consequences,— these are 

the four drugs we have chosen to .focus on;-^ In addition, -we have con- 

sidereA t^wo summary measures of drug use: a measure of vrtiether the 

individual used any drug other than inarijxaana or alcohol, and an index 

that"~weights the \ise of various drugs according to^ an estimate of th^ ' 

marginal impact of the use 6f each ort the nmhber of- arrests^ one is likely to 
'3/ 

incur In all instances, the outcome measures are based on self- reports 



' ' - 4/ 

of any use (or daily use) of the drug during the previous nine months^— 



A. OVERALL PROGRAM IMPACTS ~~ - 

' As shown by the results presented in Table. V. 2, Supported Work 
has had no overall effect on die prevalence of drug use. y During each 



— Analyses based on the* ex-addict and ex-offender Supported Work 
sairples indicate a strong positive correlation between both heroin and 
cocadne use and the number of Jiimes one is arrested (Dickinson, ,1980) / 

2/ V • . 

— Less than 1 percent of the youth reported having used opiates 
other than heroin,^ or auiphetamines , barbiturates, or p^sychedelics during 
each of' the 9-month follow-vp periods . 



index* 



Dickinson (1980) describes the development of this drug-use 

4/ 

^ The quality of self- reported data on drug use is, -of course. 



questionable. While there is evidence that such reports will 'jndetstate 
the- use rates (0'E)onnell et al., 1976), ther^^ is little reason to expect 
differential ^underrepoirting by ea^erimentals and controls. Equal pro- 
portional underreporting by experimentals and controls still poses two 
potential analytic problems, however.^ One is that the absolute value of 
any program effect will be* biased toward zero, and the other is that 
tests of the statistical significance of* estimated differentials will 
tend to be conservative. 



TABU V.2 

PBRCEN'rAGe REPORTING USE OF umJSt BY Wt OF l)m>G 
YOUTH SAHPLe 



Moaths t * 3 



Mpntlis 10 - IB 



iMperiMtntal* 

Cohtroi' 



Control 
Group 
Hen 



' experimental- Control 
Control Group 
' Differential Hean 



Montlis 19>^27- 



-lioiittis-2a-^36- 



EvptriMintal-* Control 
Control Group 
Differential . Hean 



IxperiAcntal- Control ^ 
? Control ^ ^Groupw 
Differential Hean9 



Any 0ni9 (other than 
Marijuana or alcohol) 

Wroin 



Cocaine 
Any use 

Harijuana 

Any ,use 
Daily use 

Alcoiiol 
Daily use 

^Cfndox^of ibrug Us< 



-2.9 



0.4 



-l.l 



4.5 
n.a. 



2.6* 
(-0.5) 



14.2 



3.6 



a.2 



52.4 
n.a. 



5. 5 
(9.2) 



0.3 
-0.7 
-1.2 



1.6 
0.0 



1.9 
(-1-3) 



10.2 



2.4 



a. 2 



51.2 
22.4 



9.3 
(8.9> 



0.4 



0.6 



-1.0 



0.3 
'5.4 



0.7 
(0;Q) 



10.^ 



1.2 



a.4 



57.6 
21.1 



9.9 

(6.3) 



5.8 



0.9 



5./ 



0.1 
-0.3 



-1.6 
(2.9) 



11.0 



1.0 



9.7 



64 

29 



a, 

(7. 



NCn:: Soe note to Table III. 3. " . - - 

Daily use of heroin, cocaine,, and any usa of . other opiates, aaphetaaines, barbiturateSi and psychedelics, was reported by less than 1 
percent of the youth sai^ile and so data ^or these categories are not included in this table. 

-^This index weights the, use of each drug by its association with arrests. See~Dickinson;(1980) for a description of the 
Mtfthodology used to develop the index and for the actual weights used. - • . " 

^Statistically significant at the .10 percent level. 
^^Statistically significant at the'' 5' percent level. 

iKa. s not available , 
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9-ponth follow-up period, 10 to 17 percent of the youth used some drug 

♦ 

other than marijuana; 1 to 4 percent used beroln; 7 to IS percent used 
cocaine; 51 to 64 percssnt used xnarijuana; and 6 to 11 percent used alcohol 
on a daily basis* The only statistically significant difference in reported 
— usd^between-e)qperiiaentals^and,j^Dnitj^^^^ ^ily 

(iuring.the first nine nwnSAs after enrollment, when 8 percent of tha 

1/ 

experimentals coaopared with 6 percent of controls reported such use*-^ 
■ In sibsequent periods, however, "the percentages for the groups were 



about equal (vailing between 7 and^ll percent) • 

" -feJhile lit'Ud tfvenU.I program iapact on drug use was observ ed, it 



was possible that. S\«>poi±ed Work had altered the relationship Lotween drug 
use and en^loyment, Hcv^ver, as sea^ in Table V.3, eaqperimental-control 

differentials in drug u&u i^^/^erally w^re not significantly different ftom 

< 2/ 

zero for either those who were enployed or thoge who were not exaployed.-^ 
A sizable portion of e3q>erimentals and coxitrois In both ainployment statuses 
(7 to 20 percent) reported having used drugs ether than mrijuana or 
alcohol. 

B. DIFFERENTIAL -IMPACTS AMONG SITES AND ACPDSS SUBGR3UPS OF YOUTH 

^ Deslpite the lack of overall program ^inpacts, it is possible that 
Supported Work programs at some of the sites did affect drugruse signifi- 



cantly, either because of the nature of the prpgram experieno^?* tbijmselves 



-^When 'estimated using probit analysis, this estimated differential, 
while about the same magnitude, was not statistically significant, however • 

•^The one exception is that a^significahtly lower percentage of 
experimentals than contrpls vrtio were employed reported using drugs during 
months 1 to 9. However, this is related to /very high use rates by employed 
controls relative to unemployed controls* Generally similar t /^ults to 
these for use of any drugs were also observed for alcohol xose. 

123 1-^9 ' ' 



rEROBHTACB^WPORTIMC lJSB OF-ANY-DROG; rfrilER THAN MARIJUANA OR AfXXJllOL, 
; DY CURPBMT EMPfbYMENT STATIC 

. YOUTH SAMPLE 



Months I - 9 



Montlis 10 - le 



MontJia 19 - 27 



Ejq>«ri«»nt«I- Control BxperlMntal- Control ExperiMntal- control 
control Croup Control Gron> Control Croup 

DiffTtntUl Mean Differet^ttal Mean Diffcrtnttdl 



Mean 



Montha 28-36 



Cxparimnt«l- Control 
Control GroMp 
DlffartntlM Mean 



Hot Ei^ploya'd 
Eaployed 



(Percsnjt^go Eii|)loy«d| 



2/ 



2.^ 
-6,9** 
(45,0)** 



10,1 



18,1 



(53.0) 



1,3 



(8.5)^ 



11,3 



9,8 



(59,9) 



-1,9 



1,3 



(1,0) 



8.6 



12,4 



(60.8) 



12.0 



-3,5 



(?.5) 



3,0 



16,0 



(66,2) 



NOIK: For cteflnilions of tho sai^^s used, aeo Table 11,2. Tl.cflc data are Jpl regression adjusted. * 

V • V • - 

V * ' - 

Ttioso data «ay differ so«owhat fro* t^KJee reported in Ctiapter III because of the slight differences in the saimles used and 
because these data are not regression-adjusted. 



'Statistically si^ificant at tlie 10 percent level, 
- *'Statistically 8i91ifica.it fkt the 5 percent level. 
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or becavtse of the peer-*grovp structures.. In particular/ a priori one might 
expect ther^ to be an increase in drug use among youth in programs where 
the^eer group includes ex*-addicts and ex**of fenders and a decrease asiong 

yotilth in programs enrolling^ only AFDC women invaddition to youth. ^ Simi-- 

^ ') • * - . 

larly'f one might expect relatively more favorable iopapts among those sites 

with the most supportive sipervisors* ^ 

Table V.4r^resents estimates for each of ,the five sites of program 

impacts on the^use of some drug other than marijuana or alcohol, use of mari« 

juana, and« daily use of alcohol, during each of the first three S-mohth 

• periods There are few significant ^expi^jrimental/ control-group differ- 

ences. In only one case where there is a significant, difference is the ^ 

sign of the estimated 'impa'cf^consSMjtent over!time; among th.e Bartford* 

sample,, a higher percentage of experimentais than controls reported using • 

alcohol daily, and the 6 percentage-point differential in the first 9-month 

period is statistically significMt . In four oth^r cases , the. pattern of 

restilts across^^time is consistent, although no^e of the point estimates of 

the 'iinpacts is significantly different from' zero. These cases are the 

estimated reductxon in use of amy drugs among the Jersey City experimentais, 

the redyction in marijuana tise among Philadelphia experimentais, and ' 

*^the increases in the laie .of marTjuana among experimentais 'relative Jx) 

" - • • A 2/ .•• , * . 

controls in the Hartford and Jersey City sainples.-- These results are not 

' , * ^tox two reasons-, subgrotp resxilts were not estimatecf for the 28- 
to 36-tmonth period.' The first is that the sanple size is « very small, and 
the. second is that the preenrollment drug-use experiences of the 36-month 
sample ave not at all representative of the group as a whole, as evidenci^d 
by the data in Table II. 3. ' • ' . 

• 2/ ' • - > . . ^ 

-^Any use of dr\igs is relatively high among Jersey City controls 

and use of marijiuina is relatively prevalent among Philadelphia controls 

as' compared with controls in other sites. However, there is no consistent 

pattern of the control groifl^ means associa-bed with the .higher rates of 

marijuana use among e3q>erimentals. , ^ ^ 



ThMtX V,4 

P^RCXNTJ^ R£?0Rnil6 USE OF VARIOUS DRUGS 

IT .Sin 

• ' YOUTH SAK?U 



Months *I * 9 



Monthi 10 - 18 



K^ths 



19 • 27 



D{p«r;la«nt«I« Control CsptrlMntml- Control ExptruMntal Control 
Cbntr&l ^ Group ^ ' Control Group Control Group 

Dlfftfrtntial Htan " Dlgg^rantial Mean Diffcrtntial Mean 



A. Any Drug (othtr than Marijuana or \Alcohol) • 

AU Tounh ^ -'2.9 ^' 14.2 0.3 ^ 

Sitt. ' . 
Atlanu 
' Hartford 
♦^Jtrstycity 
Ktw Tork 
Philadtphia 



'7.6 
0.5 
6.5 
-1.4 
9.6 



18.0 
11.7 
17.3 ' 
14.6 
13.2 



0.5 

- 6.5 
12.9* 



10.2 

8.1 
7.0 
18.7 

• 4.1*' 



0.4 

2''.6'. 
"5.3. . 
0.9^^' 
5.9 



10.6 

6\3 
7.5 
18. 1 
14.6 
3.5 



3. Marijuana 



All Touth . * 


4.5 


52.4 


1.6 


51.2 


0.3 


^7.6^ 


.Sitt 

AtlAHU 

Hartford' 
Jtrscy city" 
Ktw Tork 
Philadtphia 


11.4 
7^6 
8.2 
- 4.1 
•20.7 


^57.3 . 
48.1 i 
53.5 
54.9 * 
70.2 


11.9 
1.5 
3.2 

- 4.1 

- 4.7 


-J ' 
43.8 
43.6 
62.5 
fe3.9 
• 54.2 


-42.9*--' 
2-.S 

24.7^/ 
• 7.3 


82a . 
" 55.3 
57.5 • 
48.9 ' 
,151.7 


C. Dally Utt of Alcohol 










t 


All Toutii 


2.6* 


5.5 


1.9 


9.3 


0.7 


I* 
9.9 


Sitt 
Atlanta 
Hartford 
Verity. City 

' Ntw Tcrk 
Fhiladtphia 


-.3.3 

• 3. 8-' 
8!4**' 
. - 0.6^ 


10.8 
. 8.4 
0.3, ' 
3.5 
• 0.5 


2.0 

0.5/ 

2.9 

2.'4 

6.3 


7-3 
7.6 
15.4 

10\4 
1.6 . 


.15.2^' 
5.1 

. -16.5^' 
-14.3** 


17.4 * 
4.2 
13.0 
21.0 
16.2 



:?OtE: Stt nott to Tablt III. 3. 

Saojplt U^ists tot th«'varioua sitta can bt ooaputad by.nultiplying tht proportion of tht jae^lt 
in tha sita tty' tha total, aaaplt tisa* (Thtst figuraa art prastnttd in Apptndix TabU A. 4.) 
lhaxa wtra too ftv bbstrvationa to pandit Maningful disa99r«9ation of tht 78* to se-nonth 
sanplt. " 

a/ * \ 

- Mtgativt point tstiaatts of txptrijatntal or control group atans arist because/ as discussed in 

Ch4pttr XI, linear rtgrtssion analysis rather than probit analysis vas used* ^ 



/ -fsaaple si2c is 20 or less* ' 

*Sxpariaa.ncal-control diffatantials significantly ao»ng t.*;e sites. (Section II .B describes 
the ^«t procadurae usedj 

. - ' • - 

^Statistically significant at tha 10 pardlint level* 

**Sutistically significant at the 5 percent level. ^ • * 



consistent with a priori notions of e:5>ected site differentials in program 
impacts— -namely r that drug use might increase among experiitientals relative 
to controls in sites enrolling ex-addicts and/or ex-offenders. 

Prograun in^iacts on drug use might also be e^^ect^ed to vary eunong 
youth witji diffe^'rent demographic and background charac.teristics, in which 
case knowledge of such impacts could be. useful in deciding on program 
targeting strategies* Tables V.S, V.6, and V..7 display estimated program 
impacts, for a number of different subgroi?)S of the youth sairole, on use 
of any drug^ iise of marijuairiAf and daily use of alcohol; 

^ Overall f no pattern identifies a partictilar grovp. for whom Si?)ported 

Work will reduce the prevalence of drug use. There are few significant 
e:^erimental-control differences in use of any drugs other than marijuana 
or alcohol f and in only -a few cases are the estinated differences for a 
subgroup both of consistent sign in the three periods and significant in 
at' least one'. In all' three periods, it is estimated that white e:q)eri- 
. mentcils, those with some brief period of prior work, and those ^ose best 
friend does not us^"''^rugs are less likely than their control group counter- 
parts to have used drugs. However, in most caises, the estimated differen- 
tials are extremely small (less than 1 percentage point) . 

, For marijuana use', the estimates^ of inpacts for the various sub- 
groups tend to be reasonably consistent in sign across time and the 

m--v,.iltudes of the estimated impacts, furthermore, are often reasonably large 

' "I ' * 

'The pattern of results suggests that S\5)ported Work may be more likely 

to lead to increased use of marijuana among those whor as-con?)ared to 

oth^ qr^jps of youth, are Spanish, have fewer than nine years of education, 

are not receiving welfare at enrollment, and live in neighborhoods with 



?r- .127 



PERCEKTAGE REPORTING USE OF ANY DRUG, ^ 
av UEKOGRAPHIC AND BACKCROUNO OIAKACTERISTICS 



-YOUni SA>IFL£ 



Months 1 



iikll Youth 

yYe^rs of Aye 
Under l*i 
19 or older 

^ Hale 
Fesale 

lUte/Ethnicity 

Whlte« not Hispanic 
' BUck« not Hispanic 

Hispanic 

Years of Education 

8 or less 

9 or aore 

'Welfare and Food 
I Staap Receipt in 
pHonth Prior to 
V Enrol l»ent ^ 

None 
\ Some 

■ Dependents 
None 

One or sore 

^Nootlis in :4>n9est Jch 
0 

More than 12 



Experimental^ 

Control 
Differential 



MouthslO 18 



-2.9 
-1.6 



-1.7 
'9.S 



-0.5 
-3.4 
-0.5 



-2 3 
-2.8 



-1,9 
-4*4 



-i.2 
l/l 



1.8 
-S,4** 
•7,7 



Control 
Group 
Hean 


ExperiKental- 

Control 
Differential 


Control 
^ Group 
Hean 


14.2 


0.3 


10.2 




s 




13.5. 


-1.8 


U.2 


15.1 


3.7 


8.7 




« 




1 J .9 


- 1 .0 


il.4 


15.6 


9.7* 


2. a 


19.7 


•-7.8 


15.1 


14.4 


0 7 


9.9 


10 .7 


- 2.3 


9.8 


9.9 


4.8 


5.6 


i4.9 


-0.3 


It A 


IS., 


* 

0.8 


10.2 


12.3 


-0.3 


10.1 


13.9 


0.8 


10.0 


16.6 


-3.0 


12.1 


14.6 


3.0 


V.4 


14.6 


-0/4 


11.0 


9.2 


0.'^ 


il.5 



Months 19 - 27 



Experi»ental- 

Control 
Differential 



0.4 

-2.1 
3.5 



i 

2.8 
-21.4** 

« 

-20.6** 
0.5 
11.7 



0.1 
0.2 



-0.9 
2.7 



-0.2 
4.8 



2.2 
-0.5 
0,9 



Control 
Group 
Mean 



10.6 

13.0 
7.2 



9.5 
19.4 



27.2 
9.4 
6.7 



6.9 
11.3 



10.7 
10.5 

10. V 
7.8 



8.4 
12.2 
3.9 
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Ilceks Hoiked In Year 
Piior to SitrolUMsntS^ 

0 

10 



Kohth» I 



SxperiMtitftl- 

, Control 
Differential 



0.3 
-1.3 
-2.9 



Control 
Group 
Hean 



10.3 
12.3 
14.3 



Months 10 - IS 



Experi»ental- 

Control 
Differential 



-0.3 
0.1 

0.5 



Control 
Group 
Meati 



10.9 
10.5 
10.1 



Months 19-27 



Experiaental- 

Control 
Differential 



-O.B 
-0.3 
0.2 



Control 
Group 
Mean 



9.9 
10.5' 
11.0 



1 



-4 



r\3 



^Mor^'Drug Use 
Used dri^* other tlmn 

Marijuana . 
Did not use any drug 

ottter than »arijuana 

Atkiicts in Neigltborhood ^ 
Kew or none 
Many 

Best Friend^ 
Does not use drugs ^ 

and is not involved 

in criae 
Uses drugs or is in* 

volved in criwe 

c/ 

flier Arrests-' 
0 
4 

9 ^ 

Hiiiiths Since Incarceration 
Never incarcerated 
12 or less 
Here than 12 



-3.1 
-2.6 



-0.5 
-8,3** 



-5.6** 
B.5* 



-4.2 
-1.6 
1.4 



-0.7 
-4.3 
-13.4* 



32.4 
B.7 



11.6 
19.0 



14.1 
13.5 



14.6 
13.7 
15.7 



11. B 
21.7 
17.2 



-4.9 
•2.0 



-O.B 
1.9 



-1.0 
4.7 



-0.7 
1.3 
4.9 



-2.5 
7.4 
B.b 



22. B 
.6.7 



9.7 
10.7 



9.0 
14.3 



10. B 
9.6 
11.6 



9.3 
13.4 
10.9 



-5.4 
2.6 



0.6 

-0.7 



70.6 

3. a 



4.2 
-2.2 
-1.4 



-1.4 

3.0 
2.B 



4^ 



24.1 
4.9 



B.2 
15.7 



10.5 
11.1 



8.7 
12.6 
10.6 



11.1 
11.6 
B.2 



7^ 




U«^: See note to Table V.4. -rticra wore too few ob«ervatio.,8 i., the 28- to 36-«o.,th sample to permit disaggregation into subgroups. 

2/„egati'vu point osti«,.tes of experiuvental or control group »ean« ari«c because, as discussed in Chapter II. linear regression analyses 
iaih«£i: tlinn probi t uiialytiis van used. 

ll^Hclfaro includes AVtC. General Asslsta;.c-o. and other welfare or welfare income for wl.ich respondent could not identify the source. 

!^/-11,ose oatimatea of aul.group effects and n^sans are based on a linear specification of the sa>«ple characteristic, evaluated at 
tite tspticifiud points. 

ii^These results were obrai«,id fto« a regression that did .ot include the full set of variables interacting status with background 
Lliaracterititics. 

»Bxi>ori«««tal-control di f feientialu vary significantly among the subgroups. <iJectio» II .E doacribus the tost procedure used.) 

^Statistically uigiil t'icant at the 10 ixjrceiit level. 
•*titatislic-ally ni^jiii ^i cunt at the 5 percent level. 1 ^ ^ 



riAcmAisi ufbiiTiiio iiss or HAKiJuiua« 

OCNOGMrHXC JMJiUCK^^ OUIulctlRISTicS 
yoinil SAMPLE 



Mootha I /- S 



Up^rimnul'-f^- Control 
Control Groiy 
Differ«pti«l Mean 



Hontlis 10 ■ 18 



E«peri«entil* 

Control 
Differential 



Hont6a IS - 27 



Control^ 

Group "A. 
Mean 



Ixpariawntair 

^ Control 
bifferential 



Control 
Group:' 
Keaur. 



^All YoMth, 

Tears of Age 

r^UfuSer 19 
19 or older ' 

'Sex - 
Male 
^MUle 

^iMe/ithnicity 
. .Mhite« not Hispanic 
. Slacks not Hispanic 
JSispanic 

Years of Education 
* 6 or less 
, 9 or More 

;j ^Ifare and Food 
I simp Receipt in 
:,Nontb Prior to 
.Enrollsient ^ 



SoMe 



Dependents 

6u€ or »ore 

Months in Longest Job 
b 

1-12 

More than 12 



4.5 



6.0 
2.9 



6.0 
-2.4 



-8.6 
2.9* 
17.4** 



16.4* 

2.8 



9.1* 
-3.2 



S.8 
-4.4 



-5.9 
7.1* 
18.7 



52.4 



51.8 

53.3 



52.9 
49,7 



62.2 
56.4 
31.3 



34,3 

55.4 



50.4 
56.0 



52.1 
54.8 



56.8 
53.0 
30.6 



1.6 



0.3 
4.4 



3.6 
-7.3 



-22. 

1. 
13. 



10 

0, 



3.2 
-0.3 



3.9 
-13.6 



-6.1 
4.5 

5.9 



51.2 



53.2 
48.2 



52.0 
46.3 



74.5 

52*. 7 
37.0^ 



38.9 

53.1 



52.0 
49.7 



50.8 
54.8 



52.8 
52.5 
32,7 



0.3 



4.8 

-6.L 

i 

3.2 
-24.2* 

• 

-33.5** 
^3.1 
39.0** 



15.4 
-2.7 



5. 
-10, 



2 

-17, 



57.6 



59.9 
54.4 



58.4 
51.4 



71.0 
61,2 

:o.3 



46.2 
59.9 



55.3 
62.3 



56 

68, 



-7.7 
-0.2 
29.2 



59.1 
59.4 
38.1 
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;t»bioiV;4 (oontiniMd) 



Moritim I ' 9 



HontttM 10 r 18 



MbntKii 19 - 27 



(a) 



Cx|ieriiMnUlr. 

Control 
Different Ur 



Control 
Group 
Hcan 



CicptriJMntal- ' Control 
Control , CroMp « 
Diffgrthtial H«m 



ICxparaMntal* Control 
Control' Group 
Differential Itean 



tlcclw ttorUd In Year 
rrrior td lnroll«eni!>/ 

6 ' 
' 5 ' 

» 

Frlor Dru9 Use 
Uaed^drugi other than 

Mrijiiana 
Oid not US4^ any drug 

other than Marijuana 

Addicts in Neighborhood^ 
rev or none 

. 

'sift rriend^ 

Does not use drugs 
arK3 is not involved 
in criae 
* Uses drugs or is in* 
vblved in criae 

Prior Arrests^ 
0 
4 
9 

Months Since incarceration 
Never incarcerated 
12 or less 
Nore than 12 



6.9 
5.7 
4.5 



11.5 
3.0 



3.9 
5.6, 



2.1 
16.0* 



5.9. 
3.9 
8.0 



5.0 
4.9 
2.6 



52.8' 
56. 6 
52.3 



65.8 
49.0 



52.0 
S3. 3 



53.0 
49.8 



48.5 

59.0 
60.7 



^ 51.6 
' 51.3 
0 60.1 



6.9 
4.2 
i.4 



2.6 
1.8 



-2.9 
10.5 



3.3 

-7.4 
• 

8.4 

r3.2 
7.6 



4.7 

-7.2 
-3.4 



48.5 

sb.o 

51.5 

60.4 
48.9 



45.5 



48.1 

66.3 / 



43.5 
58.2 
S9.7 



49.5 
59.8 
50.7 



2.4 
1.4 

0.3 



. 3.9 
-1.2 

-7.9 
15.5** 



^ 4.9 
-13.7 



13.4 
-7.1 
-8.8 



-9.4 
15.7 
16.1 



58.6 
58.1 
57.6 



62.0 
55.6 



59.9 
53.5 



54.7 

6f .6 



56.4 
58.2 
59.9 



59.6 

,52.0 
$6.5 



^rTw^rt^fow^^Mrvationg in the 28- to 36-»onth sawple to permit disaggregation into subgroups. 

5/wolfare includes AFDC, Caheral Assmtance, and other welfare or welfare Income for which respondents could not identify the source. 
• ^lUese estimates of subgrot<> effects and «ean« are baoed on a linear tipeciflcatlon of sample diaracterlstlc, evaluate.t^at the 
Sixy^lfled points. 

S^lt^ese results wore obtained £«. * ro9«8Sion «mt did not include the full sot of variables interacting status with back.jroui.d 
diaracturlstlcs. 

trol differentials vary slgnlflcan^y a^ong the subgroups. <Sectlon 11. B describes tl»e test procedure used.) 



ex|>eri«Qtttal-con 

•Statistically significant at the 10 percent level. 
**Statl8tlcally significant at Uie 5 percent level. 



PEa(»irJU2e SKk>l(TING, DAILY USE OP ALCbilOL« 
By.OCHiOGIUtlllC AACKGROUNO CHAIUCTIiRISTICS 



Hoothi 1 



kll Youth . 

hy^ari of Age 
Under 19 
' 19 or older 

•■Sex ' 
Hale 
PcMle 

^iUce/Ethfiicity 

M;<te« not Hisp^inic 
! ftl«clc« iwt Hispanic 

Hispanic 

: Years of education ^ 
a or less 
9 or sKire 

Helfare-.aud Food 
;Ste«p Receipt in 

Honth Prior to 
JnrollMent V 
None ^ , 

: Sone 

dependents 

None 
. ^Oiie or More 

Ifonths in Longest Job 
0 

I " 12 

Hore than 12 



\ 



Experiaental* Control 
Control Group 
Pifferential Mean 



Months 10 - 16 



2.6* 



3.7* 
1.5 



2.6 
3.7 



6.7 

o.a 



1.6 
3.0* 



5.0** 
-1.4 



2.5 
5.i 



3.4 
3.2* 
-2.9 



5.5 



5.4 

5.7 



6.3 
0.3 



1.8 
6.3 
1.6 



5,9 
5.4 



4.5 
.7.3 



5.6 
5.0 



5.8 
4.9 
10.0 



5xperi»ent«l- 

Control 
Differential 



Months 19 - 27 



1.9 
« 

0.4' 



1.6 
2.7 



2.9 
-5.4 

i 

11.9** 
0.0 



3.5 
"1.4 



1.7 
2.9 



3.5 
15 
-1.0 



Control 
Group 
Mean 



9.3 . 

9.3 y 

9.2 



i 8 
0.0 



Sxperijsental- 

Control 
Differential 

T 



10. 0 
9.7 
7.1 



3.4 
10.3 



.6.8 
13.7 



9.6 
6.4 



9.0 
9.1 
11.6 



0.7 
« 

-2.9 
6.3 



0.3 
5.1 



8 
0.9 
5.9 



10.1 
-1.0 



0,4 
1.7 



1.7 
-7.9 



-4.5 
3.4 
-5.5 



2/ 



Control 
<itoup 
Mean 



9.9 



11.9 
7.0 



10.7. 
2.9 



6.7 
11.6 
2.8 



3.6 
U.l 



8.2 
13.7 



9.7 
11.9 



13.8 
8.5 
10.0 
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Mtks Workcfi III 7<ar 
frior to lA^pllMni £^ 

I ' ■ 

10 • 

trior 9nig U«« 
Us«4 drMtft ofchtr than 

MriJiMM , , 

Did not uft« any drug 

oIlMir UiM MriJiMiui 

• lUtdicU in Mtigh&Mrhood ^ 
. Fdtf or iKMM 
Iteuy 

Mtt rriond^ 
Doos not iu« drugs 
aim! it not involved 
in crino 

Ut«o drugs or is in- ^ 
volvsd in crins * 

Prior trreSts^ 
0 
4 
9 

Hoitths Since Inrarcerstioi) 
Never incarcer 'ted 
12 or less 
More than 12 



^Honths I - 9v 
tuperiMotal- Control 
Control Oroup 
Diffsrtntitl Hean 



Months lO'^* IB 



Montiis 19 « 27 



tKpsrintntal- Control 
Control Group 
Diffsrantial Waan 



KicptriMintil^ Control 
Control Group 
Diffsrantial > tkan 



4.2* 
3.4* 

2.7* 



1.2 
3.2* 



2.7 
2.1 



3,4* 
-1.0 



1,7 
3,6 
5.9 

i 

2.1 
9.8** 
-3.4 



4.6 

5.0 
4.6 



6.5 

5.2 



5.1 
6.4 



4.5 
9.4 



4.7 
6.1 
6.1 



5.8 
4.4 
5.7 



i.a 

1.8 
l.B 



-1.8 
2.9 



0.8 
4.5 



2.4 
0.0 



0.2 
3.2 
1.2 



1.6 
6.7 
-4.1 



10.2 
9.7 
9.2 



16.9 
7.0 



10.1 
6.8 



8.6 

12.3 



9.5 
9.1 
8.8 



8.8 

7.5 
15.3 



0.1 
0.4< 
0.8 



2.S 
0.1 



-3.6 
8.7* 



-0.5 
4.2 

i * 

2.9 
-1.3 
8.4* 



-0.3 
3.0 
2.2 



8.1 
8.5 
8.9< 



15.0 
7.7 



10.5 
8.7 



8.7 
13.4 



5.1 
11.5 
7.5 



9.9 
13.6 
6.3 



*!^' • flWrr^cTt^^ew^obsarvatlons In tlw 28- to 36-»ontli aimplo to perMt disaggregation Into »iubgro.ii>8. 

2/Meg*tlv« point o«tl».t«» of experlimntal or control gioip -a*i>« because, a. dlacus-ed in Chapter II. linear rogrosaion analyaia 

rittlier than proliit aiialyuin was uaud. ^ 

ij/wclf.ro includa. AFOC. General Assistance, and other welfare or welfare inco« for wt.ich respondents could not identify the source. 

-^flwse eatiutes of subgroup effects and me^ns are based on a linear specification of the sasple diaracteristic. evaluated at .the 
st«cified points. 

^!^«-ise results were obtained fro- a regression that did not includa the full set of variables interacting statu- wiU. background 
Uiaractaristics. 

*l:xp«.i«ntal-co«tiol differentials vary significantly a«>ng tlie subgroups. (Section li .B describes the test procedure ased.> 
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*iit«tistl«ailly significant at the 10 poroaiit lavol. 
•'Statistically oignlflcaiit at tlte 5 percent level. 



ICO 



Mny addicts. There is also some -indication that female and \rtiite partici** 
pants may reduce their marijuana use more than their control group counter* 
parts. However, as with the results for use of drugs in general, the %raight 
of the evidence is that there is no significant impact for any subgroup. 

r 

m 

The subgroi:^ resxilts for daily alcohol use are more mixed than 
those for marijuana use, but they also tend to suggest that if ^the program 
had any impact it was to increase slightly the prevalence of alcohol use - 
among the groups with similau:. characteristics as those among vri\gm marijuana 
luie increased. 

C. CONCLUSIONS , ' \ 

* The conclusion one must draw from this analysis is that Svppor^ed 

^ 

Work had no signif lant effect on. the drug use of youth participants. The 
.evidence, that overall null results may be due to' offsetting positive . 
results for some groups and negative impacts for others is weaki* at best. 

♦ 

Finally, a coirparison of drug, use and alcohol use between e^qperi- 

mentals; amd controls v^o were not employed and between experiroentals and 

^ controls who were employed revealed no consistent pattern of differences. 

At least among youth similar to those enrolled in Supported Work, then, 

drug use seems to be independent of en4)loyment status, perhaps because, 

as discussed in Chapter 11, the income effect of en$>loyment offsets its 

* * 

sociological effects. 
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CHAPTER VI 

IMPACTS ON CRIMIKAI. BEHAVIOR * ' 

\" ha nctttd in Chas^ttr 11/^ both sociological and economic theories 
ofi cr imin al bohavior suggest that successful Integration of youth into 
the labor force might b4 e^g^cte^'to reduce their likelihood of partici- 
..^^^ting. in criminal activities* In^^s chapter/ we use a numbet of 

indicators of criminal behavior to ^Investigate tie extent and nature of 
^ any impacts of Supported Wbrk on Illegal activities of young school 
dropouts / about 40 percent of whom have previously been convicted of a 
, criminal b1(fense« The various indicators we discuss include self«^ 
reported data on arrests / convictions ^ and incetrceratlons. 

• ^ ^ Self-reports of crime coimnisslons and Income from illegal 
activities >ere gollected;-^ however, they are of qviestlonable quality. 
For. this reason and because some pre-vious valldatlop work in conjunction 
with this demonstration and other studies has been undertaken to assess ' 
the quality of self-reported arrest data, we have opted to rely on • 
. reports of criminal justice e:qperlences.^ 



"^Between 3 and 17 percent of the sanple youth reported engaging 
in Illegal activities (mainly theft and selling drugsV during' each 9-month 
period. 

^ For example, a coitparlson cf self- reported arrest data with official 
recoros data for a sample of 774 ex-addicts and ex-offenders enrolled in the 
S45)ported Work demonstration has shown that Individuals reported orily^54 por- 
(jent of the. .arrests they .incurred, but that e)5)erlroent^l and control group 
members underrepo'rted by a similar percen€age (Schore it al.,. 1979) • While 
these results' may or may not be generallzable to the youth san^Jie, the. general 
lapllcation is that estimates of program-induced changes in* arrests' are 
ejq^ected to be understated and/ in the case of bindmial outcome measures, tha 
test of sta'tistlcal significance will be conservative. 

e - * " 

Pi liavin "and Gartner (1980) provide a ncre dataAlad justification 
fojr th«' outcome' measures focused on in the .5v?>ported Work evaluation studies. 
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In %owm rtspects, the best measure of -program impacts i's the, 
'ptrcentage arrested, as this is a clear indication of program failure, ' . 
in that arrests are .hi.gl^ly correlated with crime comznission.-'^ "^How- 
eve^, the others cin provide useful in/iormation as to the seriousness ' 
and consequences of the offenses for which 'individuals were arrested* For 

.exaaqple, we have included data on robbery arrests because of thair^high 

2/ ^ " ^ 

social costs and because there is reason ,to expect Supported Work to 

have its greatest impact on econoir^ically motivated crimes such .as robbery. 

There was also special interest in program effects on drug-related arrest?, 

.because of the hypothesis that Supported Woirk might reduce drug use and 

because .such' arrests aire likely to stem from economic transactions . - 

Although subject to distortion because of delays in the criminal justice 

system's processing of arrests, the convictions and incarceration data 
» 

provide yet other indications of the criminal involvement by ekperimental ' 
and control youth ••^'^ 



coTirse, airrests do not indicate guilt « Studies have related 
\ cn^ incidence of atrresns co chac of crime commissions, chus providing a 
^^^^necfessary link for the companion benefit-cost analysis* - ^ , ' * 

Kemper et al. (1980) for a discussion of the social, participant 
and nonpar ticipant costs and benefits associated with various types of. arrests 
«5\lb«man (1978) discusses the great public concern with robber/. 

^It is -also possible that the Supported Work progrtois may inter-> * 
vene in -the judicial process and thereby affect the disposition of 
' experimentals • arrest chaurces. 



A. OVERALL PROGRAM IMPACTS • • - . 

' ' On avex^age, the Supported Work ettployment opportunity has .noj>— 
had a signifipont injpact on criminal behavior arnong sample youth, either . 
dtiring the period when individuals were working in their progra^fi^ jobs . , 
or subseqpiently. 

• ' . ' ' • - 

i. Result:s During 9-Month Periods Following Enrollment 

As seen in Table VI. 1, durin'g tach of the first two 9-month,t 

period's following enrollment in Supported Work, about. 16 percent 

^ ^ ' \ ^' ' 1*^ . ' 

of both, the experimentals and controls reported having been arrested and, 

* *^ . • 

among those aurr^sted, the average number of arrests. per sample member 

was between 1.2 and 1.5. Between 15 and -20 percent of the arrests were 
. for robbery, and less than 10 percent were for drug-related offenses. A 
. sizable portion of the arrests did lead to conyicfe^.on and to incarceration. 
HQwever', there again is no significant difference between' experimentals 
and controls .^^^^^^^ 

' The results foij months 19 to 27" show a somewhat more favorable 
pattern, in that a lower percentage of experimenteds: thaiv. controls reported 
having been atr rested in months 19 to 27 (11 versus 14 percent) , a lower 
percerttage wCre convicted (4 versus 7 percent) , amd the experimentals 
spent an average of' 30 percen^ less time in jail than did controls (2.6 
versus 3.7 weeks). How^iver, none of these effects is statistically . 
significant. ' 

.While the results still axe hot statistically significant^ the^ 
pattern for months 28 to 36 is generaClly not favorable.- A higher per- 
.* centage of experimentals than coritrols were arrested (23 versus 17 percent) 
and incarcerated (20 versus 17 percent), ^ile slightly lower percentages^ 



tms VI. i 

ARilKSTS, BY fYPE OP OPFKNSbf CONVICTIONS^ AND XNCAKCI^KAlriON 
* yOUni SAMPLE 



Months 1 



Months 10 - 18 



ExperijMntal- Control 
Control Group , 

Differential / Mean 



.Escperiaental- Control 
Control Group 
Differential *' Mean 



Months 19-27 



Cxpe^ * dental- Control 
. Control Group 
Differential Mean 



Months 28 - 36 



CxperiAental- C^trol . 

Control Gifoup 
Differential Mean 



Fercentage with any Arrest 0.3 
Nuaber of Arrests 0.06^ 



16.8 

0.20 



1.6 

.0.03 



15.2 ' 
0.16 



-3.2 
-0.05 



13.6 
0.16 



6.4 

0.09^ 



16,7 
0.18 



Fercentage with Robbery Arrests^ -0.3 
NuMbar of Kobbery Arrests^ -0.00 



3.4 
0.04 



0.6 

0.00 



2.6 
0.03 



-1,0 
-0.01 



3.1 
0.04 



2.2 
0.02 



2.3 
0.02' 



Percentage with Drug- re la ted 
Arrests 

t 

P.ercentage Convicted 
Percentage Incarcerated 
NuMber of Weeks Incarcerated 



1.0 

1.2 
-2.7 
-0.58 



0.9 

9.1 
11.6 
1 62 



-0,5 

0.0 
2.0 
-0.14 



-.2 

8.3 
12.6 
2.37 



0.8 

-2.3 
^.8 
-1.06 



0.4 

6.7 

15.5 
3'.66 



1.6 

-1.8 
2:5 
-1.12 



1.3^ 

9.8 
17.2 
3.67 



HOrirb: See note to Tdblo III. 3. All data pertain to the full saw^le, 

^ Itobbery drresca are defined as those for wliich robbery was the luo^it aeirious charge, 6nly fiurder and feloniouii ausdult are considered 
to bo iK>re serious than (robbery. 

J ^ 

^ Drug-related arrests are defined as those for which ucircotics-law^ violation is the aost serious charge. ^ More serious charges include ^ 
»urder, felonious aiisault, robbery, burglary, larceny, notor-vehicle tlwft and other i>roj[>erty criMes, and other criMes against 'persons. , 



•Statistically 4igitificant at the 10 percent level. 
'^•Statistically significant at the 5 percent level. 



1^ 



'were convicted (8 varsus.lO percent)-"^ 

' When we looked at eacperiaent^l-control differentials separately for 

those employed and not employed, we observed no consistent pattern of 

effects". For exacj^le, during months 1 to 9, reductions in the percentage 

arrested were^ obse^d only anong those eaqperiinentals not enployed. During 

the 10- to 18-m6nth period, reductions weire not observed for experiment^ls 

in* either sub^rotp, but in months 19 to 27, significant reductions were' 

observed for enployed e3qperi!nentals,..vrtiile increases were observed among 

2/ 

those ej^rimentals \rfio were not employed,— In particular, the lack of 
any relationship between employment and arrest rates dtiring the fir^t 
9 Qonths when experiitental groip members participated, in St^ported Work 
suggests . thatj for this sanple, the lack of enployment opportunities may 
not be a principal factor in criminal, behavior. ^ . 

2* Cxamulative Results During the 18 and 27 Months Following Enrollment^ 

Cumulative measxiies of criminal activities ever the follow-up 

period provide a slightly different view of program in5>acts. .In 

» 

particular, small impacts^ during the 9-month intervals might conpoxmd 



1/ 

— RecaU.1 that the sanple size for these later period results 
'is sufficiently small that sampling error in ^estimates of program effects 
is^large^ For example, the 6 percentage -point difference in arrest rates 
is due* to a difference of only four arrests for the total sample (16 
versus 12) . ^• 

^See Appendix Table A. 25, 

'•7^ Only 79 persons had continuous- data for the 36 months follbwing 
enrollment. Thus, resxilts for months. 1 tp 36 were not estimated* 
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to result in significant Ipng-rud effects. ^ ' \ . • , 

As seen in Table VI. 2, restilts for the first 18 months fol^^<iwing 

enrollment indicate that Supported Work hafd no^effect on-criminal activities 

which/ is consistent with the findings for each of the two 5-itionth periods 

(Table VI .1). However, over , the full 27-TOnth period 'followin.g enrollment, 

there is evidence of positive program inpacts, suggesting that small dif-' 

* • < , f • 

^ferences had been acciimulating over the three 9-month periods. During 

this full period/ only 30 percent of the e)5)erimenlials, as compaired y?ith 

39, percent of the oontrpls, reported having!)been arrested since, enroll- 

ment in the demonstration sample,, and a large share of 'this reduction 

(35 percent) is diae to a reduction in e^cperimentals' ariests for ^bbery.. 

While not a statistically significant difference,^ a lower percentage 

of e^qperimentals than controls were convicted during this period -^20 

versus 24 percent) , and a significantly lower percentage of experimentals 
* 

than controls were incarcerated (18 versiis 28 percent) . 

3. In^acts for Subgroups with Varying Amounts of Follow-Up Data . 

One of the first questions that arises when cotrparing the results 
in Tables VX.l and VI. 2 is whether the favorable results for the 1- to 27- 
month period are due in part to differences in program response among 
those witt) varying airoounts of follow-vp data. In order to address this 
issue, results for the prob2U^ility of an arrest were estimated for sub- 
groips of the sanples defined by the length of the interview follow-up 
period. 
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TABU VI. 2 












COMViCl*IONS; 


AND IHCAKCCKAYXON 




"■\ 






Ybuni SAMPLE 












• 




• 






Months 1 - 


19 


.Months 1 - 




/J 


• - 


Expcri»e1ital- 

Control 
-Differential 


Control 
Group 
Mean 


ejcperiaental- 

Control 
Diff^ential 


Co/itrol 
Group 
' Mean 




Percet)tac|e &ith Any Arr«st 




27.0 


-d-8* 


\ 39.3 




Nuaber of Arrests 


u.u/ 




0 ni 


0,62 




Percentdy< with Robbery Krrests^ - 


, 0.4 , 


6.1 


-3.1 


13.6 




Ntaiber of' Robbery Arrests^ 


' 0*00 


n m 


-A m 


0 15 ' 




Percentage wit)) Drug-related 
Arrestfi-^ 


* 

-b.i 


2.1 


0.9 


4.9 




4 

Percentage Convicted 


0.5 


16.0 


-4.0 


23.6 




Percentage Incarcerated 


-0.6 


18.3 


-10.2** 


♦ 

28.0 




NiMhber of Weeks Incarcerated 


-0.7 


4. J, 


-4.8** 


10.2 




KQT£:«Sce Note to .Tublo lit. 3. Rt^uults 


for the 1- to Jb-raonth i>oriod ure not ittc 


iiuntod bocduuo of 


thu limited iiaiqile size (79} . 



*^The $<ftAple for this period includes people who completed baseline. 9-»onth, 18-»onth« and 27-«onth interviews. Therefore, ' 
the expersMcntal ^nd control-group values iaiplied by these data arc not consistent with those reported for the individual 9-iwnth 
periods (see Table VI. 1). , • • - . ' 

^RoUicry arrcttttt are defined as ttioso for which robbery wa" S.!.c mout aorious chargu, ' Only murder and feloniouu assault ate ^ 
considered ' to b^ Mjru serious than robbery. ' , 

^Druii-rulTted arrests are dtjfined as those for which narcotics-law violation is the laost serious charge. More serious charges 
include mureec, felonious assault, robbery, burglary, larceny, i«otor-vehiqle theft «..a oilier property cfiijes, and ntier criioos against persons. 

•statistically sigtiif leant at Uio 10 poroent-^levol . ^ 
**Statis^(;ally significant ut tite 5 percont lovel. 
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As seen from Taiale VI. 3, among'Tiiose with only 18 months of follow-ip 

data> a higher percentage of experiinentals. than controls were arfestecj in 

1/ 

both 9-roonth periods, as well as over the fxill 18-inonth period.-^ However, 

ft 

in most tine periods, results for those with 27 or 36 months of follow-up 
data indicate reductions in arrest rates among experiinentals relative to 
controls that accumulate over time to result ^in differences of' 8 to 11 
per^ntage points over the 1- to 27-nionth period. Lack of statistical 
significamce of these 8 and 11 percentage-point differences appears to be 
due to small sample sizes, since the overall estimate of the program effect . 
is significant (Table VI. 2). Unfortunately, data for .the 1- to 36-month 
period are available for too few sample members (79) to permit calcalation 
of reliable estimates of cumulative effects over this period.* But eyidence 
from; the 28- to 36-month data suggest that the favorable pattern of cumula- 
tive results 'for the 27- and 36-month si±>samples may not persist in later 
time periods. . ' • - 



^ BV --DIFFEPENTIAL -IMPACTS- -ACBOSS ^SITES 

Ifiipacts might be expected to vary across sites becauseoof diff^- 

ences in criminal histories of saitple members, program characteristics, 

or local labqr-marjcet 'conditions, as well as various unmeasured differences 

in characteristics of program enrollees- As seen in Table VI. -ft, experi-' 

mental-control differences are consistently positive for the New York sample, 

2/ 

and most often positive for the Jersey City and Philadelphia samples.-- 



^1/ • 

-=/lt is unlikely, but possible/ that cumulative results would* differ 

in sign from those for the individual periods. 

^'^Tobit estimates of the numbf^r of arrests incurred during the 
various time periods (se-- Y^endix Table A. 26) yield results that are 
similar to. those reports Table 71.4. 



A. Niim-HuuUi l*uritNl Kdaultb 



* 


NUHtllt* I 






- lu 




- 27 


HtMtlliX 2U - 


JO 

Mean 


CUilttol « 
OiffatxtiiLUI 


Cuiliol 
Kjm> 




Coturul 

UtUU|> 


Cuirrui 


Coiitrul 
Giuif* 


Uirfuleiiltal 




3.2 


U.4 




12.4 


n.4i. 


fi.4. 


u.a. 


H.<t. 






22.C 


4.7 




-3.7 


16.0 , 




H.a. 


mdmlUa of tuUuw*iH» 


-4.1 


U.U 


-12.0* 


2!k.M 


-b.4 


7,4 


6.4 


16.7 



tt. CuMul«Civu Huttuktt* 



CO 



27 ■•lOtlui uf followu^ 
J6 ii»>iillit» of futluw-»t() 



None Ilk k 



Id 



fexiJuriiMntal- 
CMitrul 



-l-*3 
■IJ,4 



Control 



22.2 
J2.4 
32.4 



Hi>iiih>t U - 27 



Ex|JdriiMiital- Contxol 
Cukittul GruMp 



-U.l 



n.A. 
4>.4 
32.4 



SMi^ity l*4U iMtttM |i«ikliioii«iil 4CcuriiiM«| Lu ttM ftu^t iCicufiL tfdtuilutcil liituivluw tx>u|il6ttfti. Srfiifilu muUMtM iMud for Um to 2/- <«ik) 2fl-* lu 

outcoM:i uuuU iiut luAv^ uowiluttiii All pruvlouiity kdiuJiiloiJ tiiiocvicutf, w(iil«i lltouu u:iuJ Co uKtiMCii Cliu mttult)* uvis( tlMt 27*iNaiitii pvtiod* uf ctjucitu, 
Cu«i|>l«ttufl ^11 piiivioualy itclwctutOii iitlttivldwt*. 

t 

AiMiiMj Uiouu wUM iiilu for aiTHillts 1 to 10, )o [Mircuiit <jo«|jlututi h 27-w>iith Iniervlow «iitj II puicviit coii()|««tuiJ 4 )G*Moiikh ititttivj«jwj aMJiKj lliouu wJtli 
dtiia rur looiithtf l*i tu 3/, 2& y*itvbnt ooi«|iltJitjiJ « 36-muiicIi lolttcviuwj and ««oimj IIiumm with tiiit«i for 1* lu 27-aioiitti |iario4« 2i |>urcciit cuMplulcd 
a J6*MOiith Iniutvi.jw. 

*Si4lti»tlcaUy )4i<>iiflcatiL i*t Um 10 p«»rc«i)t luvul. 

11. a. «b4itit iu)t iiV»iit<«blu. ^ 
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TABLE VI . 4 
FCRCENTAUE AHKESTEO, BY SITE 
Y0U7II SAHftE 



Honths 10 - 18 Honths 1 - IB Months 19 * 27 Mo<ith« 1 - 27 



Experinental- Control ExperiMntal- Control Experimental- Control Experiaental* Control 
Control Group Control Group Control Group Control Group 
Differential Mean Differential Mean Differential Mean Differential Mean 



All Youth . 1.6 15.2 -0.3 27 0 -3.2 M.O -B.tt* 39\3 

Site ^ . . 

Atlanta -'i.4 9.9 0.0 15.0 1.5=^ 1.6 -26.52' 33^5 

Hartford l.O 7.0 1.0 21.3 -6.6 19.0 -6.6 '43.4 

Jsr?iiy City 3,2 12.2 -4.6 25.8 . -4.1 . ^^.O -10.7 35.5 

Mew York 7.3 25.9 3.4 33.0 29.0**^ -4.3^^ 15.9^ 21.7 

I'liiladelpliia -10. 5 21.9 -7.9 31.5 -1.8 12.6 -15.2 42.7* 



Mtmji adc fioto to rdbU-in»7, \ 

^ These data are baaed on a aaaple of fewer ttian 20 peraona . 
^This negative eatiMte for the control-group »ean arose because linear regression as opposed to probit analysis was used (see Chapter JI>. 
^Statistically significant at ttie 10 percent level. 
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thus, much of »the differential inpact among 'subgrotps with varying eunounts 
of follow-up data is related to the site conposition of the seunple; nearly 
half of those with 27 or more' months of data are from Jersey City and 
Philade^lphia and less Uian 4 percent are from New -York, while only 11 
percent of those with 18 months of data are from Jersey City and Philadel- 
phia, but 27 percent are from New York, Since the pattern of impacts on 
arrests is different from the eirployment and^ total- income results (estimates 
of p3;ogram inpacts on enployment and income are positive for Philadelphia 
and negative tor Jersey City) , it appears that employment and improved 
economic status per se were not th^ mechanisms through \rtiich these -favorable 
impacts axaong selected sites occurred. 

C. DIFFEPENTIAL IMPACTS ACBOSS SUBGROUPS OF YOUTH 

I Hiere is little evidence to suggest that program inpacts on the — - 

incidence of criminal activities, as indicated by the percentages arrested * 
in each 9-month follow.-up period, vary systematically across subroups 
of youth with various demographic and background characteristics (see 
Table VI.5) . However, the {)rogreun inpacts or the percentages with any 
arrest over longer periods of time (i.e., 'any initiation of or recicjivism 
to a delinquent or criminal life-styie) suggest that the program is most 
effective in reducing" involvement in crime among those who, in the 
absence of some form of intervention, exhibit a greater tendency toward 

• such behavior: those who aire younger, who are male, who have nine or 

more years of educacion, and who have previously worked in some job* but 

1/ 

who have little recent enployment experien9e* (see Table VI* 6) 



— ^Sti)grotp results/are not presented for months 28 to 36 and 1 to 36, 
since the e:^ected nunt)er of persons arrefsted among those samples is about 25 
in each. (There are 146* persons with valid data for the 28- to 36-month- 
period and 79 with data for the full 1- to 36-month-periodJ 
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TABIX VI .5 * * 

I 

AMD UACKGRDUHU UIA|(AClVK£3rtCS 



Ml Youlh 



Month* I 



CicptriMntal* 

Control 
DifftfntUI 



Control 
Grou».* 
M« 



16. a 



Month* 10 - Ifl 



Cjcpcrifttntal- Control 
Control Group 
Differential Ht4n 



1.6 



15.2 



Month* H - 27 



Super iiiental- Control 
tontrol Croup 
UfcercntUl Hem 



-3.2 



14.0 



Vtert of Agt 

Undar 19 

19 or oldtr ^ 

Mele . 
FtMle 

l^4C«/Ithnicity 
Miitt, not Hiftp«nic 
•lack, not Hi«p«nic 
IliftftMnic 

^Ire^r* of educetion 
' « or lets 
H or aore 



-2.4 
4.7 



-0.2 
4.7 



a.9 

-0.7 
3.2 

• 

11.5 
-1.4 



19. a 

12,6 



ia.7 
s.a 



7.2 

ia.3 

13.4 



9. a 
la.o 



b.6 

3.7- 



1.6 



ii.i 

2.6 

'?,7 ^ 

• \ 

19.3** 
-1.1 



15.2 
15.3 



la.a 
23. a 



21.3 
15.4 
12.5 



6.a 

16.7 



^^4,a 

c 

-3,7 
-0.1 



-12.3 
-0.4 
-13.2 



I4I 
r4.2 



16. a 

9.3 



15.0 
2.2 



23.6 
12.0 
15. a 



10.2 
la.i 



Welfare And rood 
StMip acctipt in 
Hoitth rrior to 
l^urollaent 
JkMie 



-2.0 
5.7 



19.7 
11.0 



i 

•7.1** 

-a,a* 



13.5 

ia.9 



0.9 

-13.7** 



12.4 
16.7 



ti«peiidrntft 
, None 

* One or »ore 



0.2 

?.0 



16.5 
20.0 



0.9 
♦9.3 



15.7 

u.a 



-4.7 
11.4 



n.a 
12.1 



'Nonltift in Longest Job 
0 

1 - 12 

More then 12 



9.6* 
-1.6 
-9.2 



16.1 
17.0 
17.7 



9. a* 
-1.6 
a. 5 



14.5 
16.6 
5.9 



-1.1 
-3.7 
-6.5. 



16.7 
12.a 
11.5 
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Months 1 - 9 



ijqperiMnUl* 

Control 
Differential 



Control 
Group 
He«n 



Honths 10 - 18 



Experimental- Control 
Control Group 
Differential Mean 



Honths 19 " 27 



Experiaentai- Control 
^/ 'Control Group 
' Differential Hean 



Weeks Worked^ In Vear : 
Prior to EnrollMent^ 

5 

Priof Drug Use 

Used drugs other than 

Marijuana 
DiJ not »ise any drug 

other than Marijuana 

Prior Arrests 5^ 
0 
4 
9 

. Honths Since Incarceration 
^Never incarcerated 
12 or less 
More than 12 



.0.8 
0.6 
0.5 



-4.5^ 
1.9 



-0.2 
1.2 
3.0 

« 

-4.5 
« 21.6 
17.1 



14.2 
15.7 
17.2 



22.2 
13.4 



18.5 
22.8 



18.1 
11.8 
12.^ 



-1.0 
0.6 
2.2 



«4.4 
'1.2 



0.0 
3.6 
8.1 

« 

0.1 

1.0 
23.9' 



16 .5 
15.8 
15,1 



17.4 
14{7 



13.9 
1^.5 
19.7 



13.8 
21.0 
20.6 



.-3. a 

-3.3 



-5.5 
-2.4 



-1.1 
-4.1 

T.9 



-2.2 
-11.8 
1.8 



15.4 
14.6 
»i.7 



15.4 

13.0 



11.4 
M.6 
' 18.7 



13.7 
20.3 
5.0 



/ 



Parofe or 
Enrollment 

Not on pak'ole or 
probation 

On parole or probation 



2.2 
-4.2 



14.9 
22.4 



O.S 
S.8 



15.1 
15.6 



-6 4* 



15.1 
10.6 



NUTC: Soo note to Table III. 7. Results for the 26- to 36-»onth period are not presented because of the lit»* td sanple size (146) and the sjnall 
niwUx^r of sainplo mcMbors arresti^d during the period (29). 

"Welfare incliulee APliC, Goner al Assistance, and other wo 1 faro or wo 1 faro ipcomc for which respondents could not identify tho source. 



{Kiints. 



"^Iiesj estimates of sul>9roi«p effects and means ore basod on a inoa'' specification of tne sample characteristic, evaluated at t\\e sp* cifiod 

t 

Ex{>erimontal- control differentials within th^s subgrouping for this time period differ significantly from one another. (This tost 



ptocedure is discussed ^n Section IX. t£.) 

^.Statistically significant at Uio 10 percent level,. 
^'Statistically significant at tl» 5 percont- level*. 
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TABLE VI, 6 . -6 

CUHULATIVE PERCEHTAGE WITH AMY ARREST. 
BY DEHOORAPIIIC AND BACKGROUND CHARACTERISTICS 



YOUTH SAMPLE 



Months I 



16 



Ex^rUiental- 

Control 
Differential 



Control 
Grdup 
Mean 



Honths 1-27 



£xperi»ental' ' Control 
Control Group* 
Differential » Hean 



All Youth 

Years of 
; Under 19 
19 or older 

Sex 
Hale 
Female 



-0.3 
i 

-4.9 
6.9 



-0.9 
4.9 



27.0 



30.5 
21.9 



29.6 
11.5 



-a. 8* 

-16.4** 
2.2 



-10.5** 
B«2 



39. 3« 



44.4 

29.6 



41 .j4 
13.6 



Mace/ Ethnicity ^ 
White, tiot Hispanic 

^ Black, not Hispanic 
llispanip 

Ye^s of Education 
6 or less ' 
9 oi; Mote 

.Welfare and FckkI Staiip 
Receipt in Honth Prior 
to Enrblljuent !y 

. *None * 
Some 



0.4 
-0.8 
3.4 



15.2* 
-2.6 



1.6 
-3.4 



23. & 
28.0 
23.1 



14.5 
28.9 



27.1' 
26.7 



6.8 
-9.6 
-7.9 

2U.2 
-13.3** 



-2.6 
-21.7* * 



27.3 
39.2 
36.1 



20.6 
41.0 



37.8 
38.1 



Dependents • 
None 

One or More 

Honths in Longest Job 
0 

1 - 12 

More *than 12 



-O.l 
-O.l 



13.3** 
-4.1 



-4.3 



26.8 
28.8 



23 1 
'28.6 
»4.7 



-7.8 
-11.4 

« 

18.2 
-15.7** 
-21.2 



37.6 
40-5 



30.0 
40 7 
37.0 
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TABtS VI. 6 (Continued) 



Veeks Worked in Year Piior to 
Enrollments/ 

0 

5 
10 

Prior Orug iJsc 

Used drugs other than 
■ari3uaha 

Did not use atiy dnig other 
than iiarijuana 

Prior Arrests £^ 
0 
4 
9 

Months Since Incarceration 
Never Incarcerated 
12 or- less 
More than 12 



Months 1-18 



Months 1 - 27-^ 



Experiaental- Control 
Control Group 
Differential Mean 



Experimental- 
Control 
.Differential, 



-0.5 
-0:2 
0,0 



-7,7 
2.0^ 



-1.8 



•3.6 

6.8 
26.4** 



25.5 
26.3 
27.1 



35.3 
24,6 



25.6 
28.3 
31.6 



26.3 
30.3 
28.5 



-13.7** 
-10.8** 
-8.0** 



-^10.4 
-7.3 



-13,6** 
-4.6 • 
6.8 



-9.4 
-23.2 
22.7 



Control 
Group 
Mean 



38.5 
38.2 
37.8 



46,0 
34.6 

37.9 
37.9 
37.8 



34.4 

58.5 
58,8 



Parole or Probation at 

Enrollment 

Not on parofe or probation 
On parole or probation 



0.0 
.-A). 3 



24.1 
3S.2 



-8.3 
-7.8' 



33.7 
48.6 



turn.: See i*nl<! to Table III. 3. Results for the 1- to 36-iw>nth rcrtod are iioi presented because of the limited sas3i>le size (79). 

interviews* 

A W V » ^ , «- ..-v.. , . 

6 



rim yarnple for this iJOriod includ<fs people who coiopleted baseline, 9-inonth, 18-month,: and 27-inonth 



W*MfaM> .inchKioa AtDC, C^ino 



lal Ar>si:Jt.ince, and 'o the i warfare or- wel fare 'income for which rcspondentc could not identify the source. ^ 



These «stiBKiL«s of oub/ro.ip effects and means are basod on a linear specif Icatlon .of the sample cha,;ac:tpristic, evaluat(rt5 at the 
spcciCiod (Hjintsi. - , • ' 



• Exixirimontal-control Uffe)entlals within this sub^jrouplny for this time period differ sig^tTtc-a^ ine'anpther 



* Statistically significant at the 10 fxjrcent level. 
Statistically significant at the 5 ^percent level. 
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0. CONCLUSIONS . . . >- • ' 

t 

A . Tl\ej:e is some evidence that .^ong those individuals who enrolled • 
in the Sqpported Work pro grams, prior tp 1977 (and so were followed -for 
-at leasts 27 moaths >ifter their enrollment) , the' program did tend to 

r , * 

reduce their likelihood of participating in. criminal activities, as 
evidenced l?y the lower Incidence of arrists among experimental^ relative 
to controls. The- subgroiflps of yotith for whom the crime 'resvilts exhibit 
a pattern consistent with that for the eit5)loyTOent results are those age 
17 or 18 at enrollment and those who enrolled in Lhe pbqgram earlier 
(and so were followed for a longer period of time) . However, the sites, 
where the relatively more favorable enployment resxilts were observed 
are not the same set a^s those where there is some injiication that the 
programs" may have-.'reduced criminal activities, suggesting that the ^ 
mechanism throiiiFh v;hi.ch crime-related inroacts might occur may relate , 
more to the sociological theories than to the pconomi"'^ theories disctissed 
-in Chapter IIv Thus, the lapk of apparent program i0?)acts for the J.ater 
enrollees may be attributable to dianges in the character of the Supported 
Work programs* over time — for exan^ie, to their consider^ ly larger average 
size, llcwever, as previously noted, this- apparent reduction in program 
'impacts over time is at least partly attributable to the differential 
.impacts among sites,-- • ' ^ * 



CHAPTER VII 
CONCLUSION 



The goal of Sippprted Work is to mitigate a number of factors 
thought to be related to the unusuaJLly high unemployment* among that 
segment of the youth population tha^ wa^ the target of the Si;qpported 
'^ork demonstration — school dropouts with limited or no prior work . 
experience ^and often with a history of xKv^Ivement in' crime. The 



evidence from the National-i^i5)ported Work Demdh^cration suggests that 

^ Sijpported -Uork can be expected to have short-r\in impacts on en^lo/merit 

* and^ consequently/ on dependend^ on public assistance'. However, it does 

^ not appear t<3 be successful in its ceritral objeotivr of improving ^sbe 

^ . long-teznn^en?)l^yment prospects, for disadvantaged youth. 

Those youth who met the Supported Work eligibility criteria 

and applied to the program are among those who characteristically 
« 

have the most serious ecployment plroblems.-^'^ About 60 percent of the 
san$>le are younger than 1?, over one-third completed fewer than 10 
years of schooling/ and, over one-fifth have never had a regular job^ 
/Of those who have held a regular job, their most recent job had ended, 
on average, moie than 11 months ago. In addition, 57 percent reported 
having been arrested,, and 38 percent reported- having been convicted. 
Other characteristics which identify the youth as being particularly 



1/ * ' ' * • ' * 

— Per exainpjer see Feldstein and Ellwood (1979) for a descriptidn 

of the -employirfent -problems of youth with variotis characteristics. 



^^^^ 



likely to have limited employment oppprtunities are that 91 percent are^ 
from black 'and other ethnic minority groups (among whom the national 
unemployment rate isv adjout double" the overall unemployment • rate for 
youth) , and about two-thirds the group had been out of school for 
more than a year when they ^enrolled in the prograij. Thirty percent of 

, them reported having been expelled from school or left school because 
of problems with the police. Few of these youth were married amd 
supporting dependents, and ne^irly tj^o- thirds were living with their'^ 
psurerrts at the time of "enrollment. 

Based on the post-enrollment employment experiences of the ^ 
youth control group, however, we observed that the employment prospects 

• for these youth who applied to and were enrollad in the demonstration 

'were somewfiat more favorable than their background characteristics 
* 

would lead one to expect and better than those of the o'rher Supported 
Work target a.oups (see Figure VII. 1). By the start cf the third year 

« ' ^ 

'after enrollment, half of the youth were employe'd and they worked an 
average of ^JO hours per month. Eighty-three percent of the controls 
reported some employment during the follow-up period of 18 to 36 months. 
This g^eral upward trenc? in employment is attributable to three factors; 
a^'hormal tendency for^some youth who, because of program eligibility 

V 

requirements, were unen\p3.oyed at enrollment to become employed, the 

. . • r > ^ 

aging of these youth and improvements in local employment oppprtunities, 

due to both improving local labor-market conditions amd am increase in 

CETi^ appropriations t^geted for youth jobs. 

Employment experiences of youth controls were considJerably 

more favorable among those enrolled later in calender time, among those 



in; Jersey City and Atlanta as con^ared witl\ those in. other sites ^ among 

males as compaired with females ^ and among thosg with more as opposed 

to less prior work experience. Other^ characteristics including age, 

showed only weak relationships with employment. 

Those youth applicants who wereS^.randomly assigned to ths 

« 

experimental group ^ an»i were thus offered a Suppoiced Work job, stayed in 
these jobs only 61.7 months, on average, even though under program 
guidelines they were permitted to .stay much longer. Only 9 percent left 
after having exhausted the allow6ible .time ^in the program; yet, only 18 
percent' left to take cuiotner job. 

During the period when experimentals were employed in Supported 
Work, their hours of work and earnings, of course, exceeded those of 
controls by a significajit amount. Consequently, their dependence on 
welfare decreaised at the same uxme that their economic status improved. 

Although nearly 40 percent of the experimental youth reported 

that Supported Work had helped prepar^r^^Jiem for unsubsidized employment, 

\ • » • 

largely by teaching job skills, the* post-program employment experience of 
experimentals do not reflect such increases in employment skills: by 
-the start of the second year;^when less than 20 percent of the experi- 
mentals were still in the program, there was essential-y no difference 
in the overall en^loyment level of the two groups. While differentials 
in employment rates did reappear during the latest follow-up period, 
they. are. neither large nor statistically significant. Furthermore, the * 
estimated earnings differential during this same period is negative, 
implying -t^:lat employed experimentals earned substantially lower wage 
rates than did employed controls. 
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Perhaps the most noteworthy factor concerning these employment^ 
results is that both experimentals and controls e?diibited a reasonably 
favoreUDle pattern of employment: during months 19 to 36, between 61 and 74 
percent of the sample reported employment during each 9--month period/ and 
ttose with some employment worked the equivalent of about t^o-^Jiirds tix^e • 
at wage rates^ averaging between $3.41 and $4.13 per 'nour. 

In compciripon with other Supported Work target groups, youth 
experimentals had employment rates dxiring the 19- to 36-month period 
that averaged 9 to 25 percent higher and they worked between 12 and 25 
percent more hour"? (though at substantially louer average wage ratjs) . 
Thus, that this^ group exhibited less employment gain vis-a-vis their 
control counterparts than other target groups appears to be due to 
their having a less chronic problem at the time of their enrollment, 
as evidenced by the previously noted more favorable employment experiences 
of their control group relative to .those of other target groups. This 
conclusion is further :.apported by \:he observation that those youth 
for whom relc-.cively more favorable (though generally hot significant) 
patterns of effects were' estimated are those whose control group counterparts 
had low employment rates and levels—for example, the earliest enrollees 
in the demonstration who faced the poorest labor-market conditions^ those 
in New York, Haxjiford, and Philadelphia, and those who were younger 
than average. However, the findings of\this study provide little 

evider^ce that retargeting the program on a different subset of youth 

' ^ " I ' 

would substantially alter the program's impacts. ^ 

, Experimental youth did stay in Si:qppQf ted Wolk longer than 

controls, over th^ sam^ period stayed in nonprogram jobs (6.7 months 



vfers'us 5.6 itbnths for rionprogram jobs)* However, longer tenure in * 
Supported Work jobs has not been found to result in improvements in 
other dimensions of employment-related outcomes, such as employment ^' 
rates; employment levels, or wage rates. Similarly, the Supported 
Work experience did npt lead to substantially 'different types of jobs; 
among both experimentals and controls, two-thirds to three-qu^ters of 
their nonprogram jobs were in the manufacturing, retail trade, and ser- 
vice industries, and they were mainly in clerical, servicfe and miscellan- 
eoiis occupations • ^ ' 

Among the reasons for public^ concern With the high rates of youth 
unemployment is the belief- that unemployment contributes to drug abuse 
and criminal behavior among young people • Yet^ this study -provides no 
support for such beliefs. Even during the first nine months a'fter 
enrolling in the demc^.stration when experimentals ha.d been offered a 

^rog3=am-4ob^tl)e extent of drug me and involvement in crime were similar 
between experimentals and controls: roughly 13 percent reported using 
drugs (other than marijuana or alcohol) and 17 percent were' atr^ted. 

As a consequence of thefee limited program iiapacts, t^e estimates 
of the net social costs;, of Supported Work for youth are high: costs are 
estimated -to exceed benefits by an average of ' about $1,465 per participant. 

^ Thus, a^ecision^'as to whether or not Supported Work has a place among 
federally sponsorsi youth employment programs is a matter of judgment as 
to the reliability of this estimate of the require<^ net subsidy 'and the 
unmeasured social value of achxeving relatively modest short-term employ-" 
ment and ircome gains. * ' 

J "Si In arriving at such ' judgtusnts about Supported Work, if is important 
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1 to recognize the limitations of the demonstration's findings. The roost 
\ serious' limitation is, of course, the paucit^'of observations on which 
I to base' estimates of long-term impacts "^ftbwever', another failing is 
'Ithat the research did nqt explore- fully the "causes" of the program's 

lappaurent lack of .success^ in improving ,lori^er-t;erm employtner\t prospects 

\\ ' • ^ . > 

for the target population. While the ^ur^ent data base would support 

1 ' • " r ■ - ^ . • * 

aimore thorough analysis of the , causes of- yojath unemployment and* of 
Sil^orted Work's limited 'achievements / the reliabili^ty of the estimates 
of lortger-term impacts could bfe improved only through further foilow-up 
of th€f sample. 
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TABLS A.I 

CHARACTSRISTZCS 'OF'SKPERIdeMXAL AKD'CONTBOL GBOCP SCMBEBS AT ENPOLLMENT « 

yOUTH 3MLE 



Characts ristlc 


Ssqpariatntal 
Group Haan 


EsqpariMntal* 

Control 
Diffsrsntial 




18.22 


-0.04** 




o;88 


* 0.01 


Proportion BXadc 


'\ . 0.74 


0.03 


H\ito%t. of Dtp«^dtxics 


U. 




MuBlMr of Ytars of Fonul Education 


9.62 


•0.06. 


Muab«r of Wmics Worind Last 12 Honths 


.9.45 


-0.09 


Av«ra9»-Wr,9« for Ttsosa Saploycd tast 12 Honths 


2,63 


-0.17 


Cktaained tacom Last 4 WmXs 


,56.14 


-2.43 


Proportion Rscaivin? Wt^art 


0.13 


-0;01 


:iua^r of Arrasts 


. 1.99 


-0.67** 


'MuBbsr of Con^rLctions 


0.52 


.--0.23** 


Proportion Ev«r Ostd Orugs^ * 


0.23 


-^.02 


Proportion Ev«r Cttad fitroin 


0.07 


-0.01 



notS: thast data partain to tha total yotztfa^MiBpla and-ara tajcan from Jadcson et al. (1978) « 

Tabia 3-3. \ 

^ / • * \ 

^ This includas only individuals who hava us ad drugs othar than marijuana and alcohol. 

••significant at cha .05 laval on a two-tailad tast. ^ 



. • ' TABLE Ai2 • •• . 

SAMPLE SIZES ECR ANALYSIS OF VARIOUS OUTOOHE ICASURES IN ^RIOUS TIHE PERIODS 



Months Covpved ^By. Outcowe -Measure 



Outooiie Nea'sutes 




1^18 


19-27 


' 28^36 


.1- 


-27 - 


1^36^ 


Enployaent 




^ 849 


508 


153 


-n^ 


a.- 


n^ai 


Inpome^ Sources' and Welfaire Dependence 


T 








n. 


a.- 




Use of Drugs (other than Matijuana) 




852 


507 


151 


■n. 


a. 


* n«al 


Use of Hdri.juana,.Enroligient'in Drug Treatment, 














ft 


Drug Use Among Saiii£>ie Subgroif>s 




739 


497 : 


151 


n. 


a. 


n.a* 


Daily Use of Marijuana, Index of Drug Use 




733 


488 


143 


> n. 


a. 




Indicators of Criminal Activities 




809 


507 


146 


.379 


79 

*-* 


Total Potential Sample^"^ 




861 


513 


153 


419 


' Pl 



a/ 

- This inclu«3es^l individuals who conpleted the required interviews: the potential sanple 
for i- to IS-month ouuoonfes includes all who coB4>leted an enrollment, a 9-i»onth, and an iji^-inonth inter- 
>aew; that for 19- to 27-inonth outcomes includes all who coapleted an enrollnent and a 27^month inter^ 
view; that for months 28 to 36 includes all who completed an enrollment and a 36-»on"th interview; those 
for months Ixto 2/ and 1 to 36 include all who completed all scheduled interviews to the 19- to 27- 
und the 28- to 36-moh(:h interview, respectively. 

II. a. means not ap{>licable. » 



NOIfflERS -OP INTERVISWS^^^ COMPLEiED 



i htirviatir Typii 



NuS^f " 



Cdqpieti 



Per.cejitage 
Collated . 



9>n>ohth 
18-nontii 
;27rBonth 
3^«n6hth . , 



3252 
1252 
1252 

.71. 

202- 



1244. 

1001 
924' 
506 

. 155 



.99.4^ 
80.0 

73.8 

1 . 
70%4 

76.7' 



Tliese data are from Jackson et -al. (1979), Tables II -1 and 



HOTE: 



-^These fibgurei include three persons ^o conpleted e siibstitute 
eriroilxnent interview at this, time of a subseqiiently scheduled foilow-ijp 
int^irview*- Thi^; do not. include individuals who conpleted substitute _ ^ 

^toiiow-up interviews* > ' ' ' ' ' ^ , ^ 

'* . ■ • ' . , ' ' 

^Ohly those enrolled. prior to Jalhuary' 1977 were .assigned a 
27rnionth interview. . , 

■¥only tho<e enrolled prior to April 1976 were assigned, a ^ 
36-ni6nth interview. 



















• 






' • (Stindard bivittions ef"^^ 




















~ Voiitcol^eW 


' Outcomes 


^ 28-36 Month. 
Outcomes^' 






• Eii^trintiital*. <3rbt4> ' 


,0 :.4^8 


0.472 


b.497 




i - 

e . - 

h\ ' 




0f^88 
^ b:i47 


0.283 




" * 




Xrettntnt.br'CriAinal Justice 
. Agency ^tozippiy^^^ 


0,065 


0.099 


0.085 






;Si^te 
'Atlanta' 
HaFtf ori- 
Jersey, f^itv 
*Ne*f Toric ' \ 
^ 'PhUadel^a 


0;446 
. 0.225 
. 0.159 
0.P77 


U .U40 

0.4S3 ' 
- -0.333 
0.035 
6.154 . 


u .u 
0.131 
•0.555 
0.0 - 
0.314 






. :Montis;;oif\ProgrJUi-0^^ 

1*3418* ' ' 

> 18 ' - 


0.342 


0.»2 


o.b - 




r * 


Area 'Aiefpio^'menJ:. Rate During 

Complies With formal Program 
Eligibility Criteria 


(2.684) 
0.732 


X* 

\ 

(2.981) ■ ' 


:~ (2i28fl 






Age 19 or, older 


0.403 


0 414 ' 


0 430 






' Male 


■ \ 0.862 


0.892 . 


0.941 






Race/Skhnicity 

white . non^RisD^ic 

**«a^%^ 0 4awaa * i A jw^taa »w , 

Hispanic 


0.060 
o!l55 


0.147 


n A.71 
0.121 




V 


, " ^ More^ than 3 Tears of School 


^ 0.348 


0.835 


* 0.317 


j 




'TinerSince-Last'"Enrolled-~in- - - 

School^' • 
1' Tear 
1-2 .Tears 


0.367 
0.267 


0.340 
0.301 


0.4D4 
0.244 




> 


a/ 

Reason Left School- 
Expelled 
Trouble uith Lav 
Wanted a Job 


0.155 
b.l4S 
0.'287 


0.15S 
0.177 
0.288 


0.111 
0.222 
_ 0.3S3 




» 

1 * " - 


Kunber of Persons in Household 


4.923 
^2.563} 


3.059 
vf.-^37) 


-4.979 

• (2.571) 






nAny Dependents 


0*102 


0.086 


0.053 , 






Raised by-'' 
One Par.ent * 
two Parents 


0.364 
0.347 


0.529 

i?^400 


0.444 
0.477 






' Currently Living with Parents-^ 


0.701 


0.717 , 


0.760 






Any Food Stamps or Welfare 
Last ''Honth 


. 0.343 • 


0.304 


0.253 


■l\ 




Total income Last Month-'' , 

< ^ • * 


120.15 
(132.74) 


122.37 
(140.37) 


127.95 
(129.13) 


■ - ."i 
-»? 

' ''f 'l 


1 . ... - 

1 ERIC 


Earnings. Last Month-^ 

Any 
' Amount 

. . . 4^ • ; 


0.-572 
.67.24 ; 
(98;44) 


07605^ " 

74.00. 
(104.04). 


"""'0^633 

87.25 
-(105.30) 

0 

















KUNS^ OF CONTROL :miABi£Sr.USEO IN REORESSXONS 
(SUndtrd Dtviatioris of Cbntihuolu Variables ere in- Parenthttcs) y 



Sample 



:i-lS Koath 
- Outcdaes 



19-27 .Hon th 
Outcomes 



23-35 Month 
Outcofliei 



Unei^'loyiMnt Cooipensation 

Last Mdnth^'" * ' : 



f 


Any; 
tabuht 


4^28 
9.08 
) (33.60) 


0.035 . 
6.37 
. (37.20) 


^' 0,034 
8.87 
(50.22) - 








wcxxarv xasc noour^ 
Any 
Xnount 


-0.131 
4 22.30 

(67.34) • - 


^ ' oa22 

19.83 
(64.02) 


0.114 
16.48 
(49.63) 




' ''A 


1 


Food Stanps last Honth-' , 
Any 

8omu v^^ 


' 0.252 
^ 20.04 
(38.£(b) 


.0.205 
15.46 
(36.15) 


0.149 
7.81 
(18.26) 




' \ 

A 
-} 

^ "r 










i * • 


Other IJnearned Xhcone Last Month--' 
Aaount ■ • ' 


5.49 * 
(31.35) ' 


6.71 
(36,93) ^ 


7.54- ^• 
(40.13) 


( 

« 


* ** 


— — 
\\ • 


. Ueeki Worked in Prior Tear 


'9.359^ 
. (11.684) 


10.172 
(12.362) 


12.659 
(14.013) 






I ' 


Leiigth of^ Longest Job Ever ' 
■ i^rnpnuis or less 
More th^ 12. months * 


0.076 


' 0 . 687 
0.076 ^ 


0 . 687 * 
0.099 




A 




4 .or nors^ vksejcs oc joo irsuun^ 
Prior Tear^ ' 


0.109 ^ 


0.107 


0.139 








Used;Any Drugs (other than r,' 
narijuana/ 


ft O'X'X ' 


0.300 


0.411 






^ > c/ 
Used Cocaine- 


6.129 


O.ISO ' 


0.187 




1 ^ 




Used.Alcohol Oaily^^ 


0.058 


0.072 


0.077 








Best Friend Does Hot Use Drugs * 
ana is Not invoivea in crime-* 






0 715 








' a/ 
Many Addicts^, Neighborhood*' 


.0.323 


0.352 


* 0.340 






1 


Ever Arrested 


p. 542 


0.638 


0,641 




t 




. Number of Arrests 

♦ • 


2.250 ^ 
(5.305) 


2.868 
(5.024.) 


3.000 
(5.?25) 






\ ' ' 


^ ' Tine since. Incarcerated 
12. months or less 
More than>'12 months 


o:i74 

0,112 


0.191 
0.199 


0.204 
0.^03 


9 






^ Oh Parole ^or Probation^^ 


0.271 


0.321 


0.316 








Kaximun Number of Cases in 
Regressions 


861 


513 


153 . 







NOTE: -Means of these variables will vary slightly. .from one set of regressions to another J?e cause 
of^siightly different .sample ^sizes for analyses of various outcome, measures. The^ may also 
vary f rem those .presented in Table IX. 3. because the above means were obtained from actual 
analysis samples as opposed to potential sauries based on interview completions. 

^^These yerlables were included oray in regressions ^to estimate subgroup effects for 



individuals with the various attributes. 

b/ 



^lArea iuiomploynent rate wais ultimately excluded from regressions because of its rtigh 
correlation with the site variables. The 1-18 month value pertains to months 10-18. * The 
value for l^nths 1*9 is 8.62 percent. 

: ' These variables were included only in regressions where the dependent variably was the 

post-enrollment value of the jsame«. 

. < , ♦ • •' 

* Sethis variable was included only in- employment-related regressions. 

i'this variable was included only in regressions where indicators of drug use and criminal 
O ''''l[cUxities..wereAthe dependent variables. 



ESTIMATED- COBSf ICI&TSI.CW iC^NTRO^^ 

USED- IN -SELECTED ^RE?aE.fSX0^^EQyi^5^^ 



Control . VariabXe - 



Kours^Eo^loyttd/ ' 

Pjtr Health , 
(Months I9-t6 ^7)^' 



as«d Any 0ru9« 



(Months 19 to 27)-' 



b/ 



Any -Arrast;, 



(Months 19 to 27ii=( 



Aoouht.'of FoIXbw-up Data 
i7 'Months* ' • 
^^iontiiSi _ 

Atlanta. 
\ Hiurt^brd^ 

Jirsiy City 

Saw York * 
• Phiiadsiphia ^ 

Months: of Program Operation 
» 13-18 - 
> 18 

Complias with ?onaaX Program 
Sligibiiity Critaria 

Aga 19 or Oldar 

Mala, 

Haca/EtHnicity 
-Whita , ^ Nbn-Hispani c 
• .cUspanic 

Mota than 3 Yaars of School 

Number r'of Parsons in Housahold ' ^ 

Any Oapan^ants 

Any*Food Stamps or Walfara Last 

' Month^ ' 

WaaJcs Workad in Prior^ Yaar 

Langth.of Longest Job Ever 
12 Months or Lass 
More Than 12 Months 

3 or Mora Weeks of Job Training 
Prior ^ear 

Used Any DQ^gs (Other Than Marijuana) 

Ever Arrested 

Number of ^i^rrests 

Time Since Incarcerated 
12 Months or Less 
More Than 12 Months 

On Parole or Probation 

Constant 



--n.a,' 


n,a, 

. ' " 'n,a. 




n.a, 
nia. 


42,11 

-23,36 ** • 
n,a, * 
-53,07 *'' 
-40.53** 


-0.12' 
-O.U 
% n,a. 

-0.03 6 * 
-0,15 




-0,09 • 
0,01 
n.a. 

-0,04 ' 
0.06^ 


14,87* 
19,90* 






' -0.08* 

* -o.ib 


1.06 
14,03** 


o:o4 

-0,02 




.-0,06 
-0,07** 


43,50 ♦* 


-0,01 




0, 13** 


33,20** 
17,18* 


* 0,09* 

o,oi 




0,04 
0.00 


15.18* 


0.05 




0.05 ' 


0,28 


-0,00 




-0.01 


-18.52 


0.00 




0,05 


t18,96** 
0.72** 


0,02 
-0.00 




-0.03 
-0.00 


-2,42 . 
^ 9.67 


0.02 
-0.06 




/ -0.07* 
-0.07 


-0,93 


n.a. 




n,a. 


-4.48 


0,10** 




0.02 


-15.64* . . 


. 0.03 




0.02 


-Oi32 ■ 


-0.00 




0.00 



V 



16,42 



n,a. 

24.26 



-Or02- 
-0.01 

n.a. 

-0.02 



-OrOl- 
-0.06 

"0.00 

0.19 



Number of Cases 



508 
0.14 



507 
0,09 



S07 
0,03' 



^ This equation ilsp included five binary variables Indicating dxperizentai status :Ad sita 
(i.a.w itatus»Atlanta/ . . ./ atatys*Philadelphia) • Program affects estimated from this equation' are 
repor^d In Table III. 7. '**•''*>. 

^ ^his equation also incUided five binary, variables Indicating experimental status and site 
(i.e., status*Atlanta/,. . status*Philadel?hia) , Program' effects estimated from this equation are. 
reported in Table v. 3.. * • - « . 

c/ * ' ^ 

^ This equation Included two binary variables Indicating experimental status and amount of 
follow-up data (i.e./ status*27 months and status«36 months). Program effects estimated from this 
equation .are reported in^ ^<Lble VI. ^. \ ' ^ 

n.a. maans not applicable *\ 

♦'Statistically slccifiijant at the l6 .percent level. ^*r^o-**aiIed t*st. 
** Statistically significant at the S percent level two tailed test. 



:ESTIKATED;.RECR£SSI0N:X0EFFICIEKTS.0N-VARM 
^ ' USE01t6LPMDICT°WEEKS'::W0RidB0>BV'^^ 

^(Omitted* viriables ih:parentKeses)- 



Variable ' 



Estiaated'; - 
-Cba'fficicnt- 



Si'qnlf icance Xevel ' 



^^^^ 



Atlanta 

Hartford' 
^(Jirsey City) 
kaw TbrJc v. 
Philadelphia 

(Bnroilfd^afbre July 1976) 
Enrdlltd Juiy-Deceinber 1976^ 
Enrolled 1977 

' .(Age i' V) 

Age as 
Age y 20 

Hale 

(Feitti^lt) 

White: , 
Hispiahic 

.(BlackVand Other). 

(<iO tears of School) 
:iO 'Tears of School 
:^iO'7cars 'of School 

< 1' Tear .Since .School 
1«2. yearsjsince School 
(>2^7eafs Since School) 

Expelled From School or Left 
^ 'Because of Trouble With Law, 
(Left School for Other Reasons) 

Lives- with Parents 

(Does not Live with Parents) 

^Raised^by Two Parents 
(Not raised by Two Parents) 

Harriedvahd/or Has Oependents 
(Not Harried and No Dependents) 

.Recftiving Welfare 'ora.^ 

^ Foo'd^'Staiapc ♦ 
(Not Recfiving^Welfare) . . . • 

(No jPt:evious Regular Job) ' 
-tongas t: Regular Job Lasted 

.<f;Honths; ' 

Longest Regular Job Lasted - > 
i6 HontSs, r 

(No-JpB^Traininqf in Past Teer) 
Some^ Job ^Training in Past Tear 

tNayer ^tJfid ^Any 
V Used: Only Ha ri j uana . 
Used ■ Drugs; 0 the r". than 
Mari'juana * 

(Never -Arrested) 
pne%pr More Arrests 

(Not > on Parole or Probation) 
' On far ble ' or P rbbat ion 

Constant 



-lr66 


•0.'36 , 


^ 72 




11U 2 


. -3,66 


0 




-9,77 • 


i 

V -2,45 


1 




'X^. ox 




u 




6.20 ' 


2.19 ^ 


3 




7.32 


2,54 . 

• 


1. 


• 


1.34 


0.48 






2.54 


0.81 . 


42 - 


.2;45 


• Q.69 


49 




7,14' 


2.18 


3 




•1.28 


- ' -0.29 


78 




4 27 




' 14 
% X*t 












-1.83 


• -0.76 - 


"-4S' 




*2,14 


0.77 




• 


2.93 


1.13 


C 

.26 




1.39 


- 0.^52 


60 




-2.11 


-0.94 


. 35 




-3.41 


-X.38 . 

s 


17 




-2.60 


-i.2i ^ 


23 




r2.07 [ 


-0.58 


37 




-2.73 


-1.06 


29 




1.76 


0.69 


49 




5.57 


1 .74 


o 




o:86 


0.28 

t 


78 




•1.-56 ^ \ 


-0.65 


52 . 




-0.65 J . 


-0.22 


82 




-1.96 


-0.78 


44 




-0.83 


. -0.33 


74 




^20.02 




. - -0 





Average Number of Weeks 
Worked* 



' .^ 'Huaber of Observations 



22. 1« 
0.06 
446 



E6TIM&T£D^.REGR6SSXdN' COEFFICIENTS '.ON 
" ''^miMLESKUSbi^TO ^'pteoiCT;^^^ 
. EXPBMMglTJaS''rW0W^^ JOBS 

(Omitted^varijibles Jii^^parentheses) . . 



Variable 



.t- rat 10 



Significance Level (%) 



Atliuita - * /^2.Z7\ 

.HaFtford^. _ -SiSO- 

, (Jersey C^^^^ ; * - - 

New, YoVic, - .1-.37- 

>hiiijd.elphia •19-82 

(Enrolled; Before July 1976) 

^Enrolled? aulV-Dec«Bbtr 1976 •Srii 

Ehrblleil 1977 • -5.48 

Uge:< 17>. 

Age -18 C.06 

Age 49 ' - -O.BB 

Age > 20 . ^ -l.Sr 

Male -5.83 
(Fenale) 

White , ^ -1.99 

:Hfspahic ' 2^2Q 
(Blacl^ and Other) 

( <: JIO. Years of School ) 

10 ^Tears or School^ , r>.94 

> 10<Years of School * 3.58 

< 1 Tear Since School -0.16 

1-2 Years Since School 2*13 
(> 2*^ rears Sincie -School) 

Expelled From Schoor or Left 

Ba^ause of Trouble. With Law ^ ' -3.37 
(Left ^School for Other Reasons) 

Lives with Parents, 0.84 

(Does not Live, with Parents) ' 

Raised by Two Parents* 4.16 
(Not raised iJy Two Parents) 

Harried and/or Has Dependents -5.50 
(Not .Harried and No Dependents') 

Receiving Welfare or F^od 

^Stainps ' ' 2.70 

(Not. Receiving Welfare) 

(Nq Previous Regular Job) - 
Longest Regul^r^^X^ Lasted 

<^6 Months^ '± , ' ""^-^^ 
Longest Re^|^^f^ob*4asted 

> o Honths5^^ 4.17 

(No Job Train^g in*Pafst Year) 

Some Job Training in ^ait Tear 8,40 

♦vNever .Used > Any <5 rugs - 

Used < Only Ha rijuana " ^^.77' 

Used iirugs Other than L^-^ ' 

Marijuana ^^■^^"^'^ ^'^^ 

(Never^ArrS|»tedr 

.^One-Tor More Arrests ^ * . ' -2-.46 

(Not on Parole or Probation^ • 

On. Parole or Probation ^ 1.10 

Constant ]^3.1^ 



-0.53 
-2.11 

0.34 
-4.59 

-rl.77 
-1.71- 

-0.75 
-0.28 
-0.33' 

-1.71 

-0.43- 
0.73 



2.44 
1.22 

-0.06 
0.78 



0. 3? • 

1.93 
i 

-1.56 

1. '^3 

1.95 
1-33 ' 

'2.91 

1.14 

0:53 
* < 

-0.96* 

0»39 
5.99 * 



60 
4 

73 
0 

8 
9 

46 
78 
74 



67 
46 



2 
22 

;^ 95 
• 43 



16- 
73 
• 5 
12 

30 

S 
13 

0 

26 
60 

34 

69 
0 



Average Number of Weeks 
Worked ^ 



29.31 



' Number of Obser/ations, 



O.U 

> « 

404 



16«. 



2Q0 



SSTZMATSS OF iUROCNAL XNPACT5 OF mXOtB: /QUUUuiTE^^ tZKEtXi^D OF TERMmTING 



.1 ^iMon-,fdrAT»rmln*tion...- 





To Taka'Anothar Job 
-or Job Training 


a/ 

.Parfomancar- 


' Othar 


Atlanta. 

Hartford^ 

CJtSiyrcityi 


V 

0.03 ^ 
0*04 

-0,06 
0*27 


O.04 

0.09 

0.29* . * 
0.23 ' 


-0.07 
-0.13 

"-0.22 
-0.50 


Enroiltd 1976 c 


. ' -0.18** 
-0.17* 


-0.06 
-0.13* ' 


-.0.24 
0. 31 


(Aga < 17) 

:Ag«-^20 - • ^ 


-0.01 

-0.00 * 
-0.15 


^ 0.11 
0.13 
0.11 


-0.10 
-0.13 
0.05 


Mala! , ' 
V ranuii6 / ^ 


0.05 . 


-o.oi 


-0.01 


whita ' , , ^ 
Hispanic . 
(Blade .ana' ocnari 


0.01. . 
0.01 


-0.00 
0.01^ 


. 0.01 
0.(f6 


(< 10 Yaaxs of School) 
10 laax^ of scnooi 
> id Yaars 6t School 


0.10 


— ft 1 A N 

— ^ 

.■ ^U' 


-0.13 


^ 1 Yaajr'::,sxnca scnooi 

1-2 Yaars Sihca Sdxool ^ 

(> ■ 2-yfiajRi Sihca School) , 


(\ (\A. 

-0.04 . 


-o:oB 


" -^0.07 
0^1^ 


Sxpaliad: from School or Laft Bacausa of 

Troxibla witii Law * . - ' 
(Lift School for OtKar Raasons)i^ ' ' ^ ^ 


-0.15** 


0.16 


-0.01 


Livas with Paxants 

(Ooas Uot Li.va with Pazants) 


0.08 


-0.09 


i0.02 


Kaisad by TWo-?Parant»^ . " 
(Not Haisad by two Parants) 


0.01 


-0.02 


0.02 


r 

^^rri'ad and/or Has Oapandants ^ ' ' . 
'(Ko^ Marriad and Ho Oapandants)' ~ 


* ' -0.01 - 


' -0.01 


0?J2 


(Not aaoiivthg Walfara) ' . 


-0.01 


-0.10 


0.11 


(No Pravious E^gular Job) . ^ 
Longast Bagxtla^Job Las tad <^ HontHs 
Longast .Fagular Job LastaH^i 6 Months ^ 

(No Job Training, in Past Vaar) 
Son Job Training >n ^ut^^i^t 


0.05 
, 0.12 


-0.04 
-0.24* 


0.01 
0.12 


0.03 ' 


-0.12 


_ J- _ 
0.10 


(Navar Usad Any Drugs) . ,^ 
Usad 6nly''Ma;:ijuana 

asad DrugS'Othar than Marijuana ^ 


0.06 ^ 
-C.02 


-0.04 

jO.14 


-0.03 
-0.12 


(Navar Anrasdid) * 
ona or Hora Arrasts 


0.02 


0.08 


-0.il 


(Not on Parola or'Probation) 
Oh/Parola or Proba'tion 


-0.02 


-0.01 


-0.03 


Constant 


-0*20 


0\24 


-0.04 


Pareantaga of SaiBpla 


19^17 


^4.36 


36.47 



NO^: Samplas usad ara dafinad in Tabla ZZZ.l. Tbasa astimatas of marginal impacts ara basad on 

polytomoas logit analysis which pradictad accurataly raasons for tara£nation o^ 55 parcant.* 
J of tha saspla. * • * * ^ 

* ^. 

I^^This catagory includas 'thosa who tarminatat^'bacausit of conflicts with tha boss or craw maxbars 
usa of drugs or alcohol, i.llagal activitias or incarcaration, absantfeaism. ?cor .ounctualit*/, or low , 
prbcuccxvxiy. . ^. • ^ 



'Statistically significant at^tf.a 10 parcant laval« 

VstStistioaiyt-significant^ S .parcant Uytl. 



TABlI Ai8a 



PERCENTAGE!' OF EXPERIMENTALS REPORTING 



TING VA^OUS- ASSfesSMENJiS OP SUPPOlWED WORK ^ 
YOUTH SAkPLE ' - >- • 




1 



j.--MohtKs in Svg)portea Work Jdtt . \ 
Less'- than 3\* 3 tb;i2 , 12 or" more *fotai 



o 



Supported Work VxepAxed Kin/Her tq C^tain^Ragular Job 

Prepared Hi»/Her by Tfeachl^^ ^» ^ 

Job skills, trade; /^ /^ ^ . ' • * 

Better work habitslemd attitudes 

Other^^.--'^'^ — . ^ 

Most jip ortaritvltesult from;Work ing in Si ypotted Work is: 
^Learning jobs skiJ^'s, tra^ - ^^----^ 

Developing better Work: hSed>its and attitudes ' ^ 

Havirg';: a steady job and'incoHie' ^ * * 
Developing self-confidence^, self-esteem 
Staying out of ' trouble and/or of f drug^ * 
Other things 

Nothing * . . 

There Were Things He/she Did Not Like About Si5>ported Wo?k 
How Program was ruiJS/ ' , 

Low pay^ ' . 

Othe'r coBplaints^/ 



23.5, 



^62j5 
- 31.3 
12.5 



17,2 ~ 

a. 4 

•20. 3 
9-^4 
3.3 . 

.12.5 

4,5.; 

49-. 6 
•28.0" . 
26.9 
46.2 



36.7 



80.0 
40.5 
10.1 



-27t8 

10.1 . 
16.7 

5.6 

2.0 
22.7 
36.9 

38,1 .• 
30a 
17. '3- - 
S7.5 • 



55.3 



66.7 
19.0 
21.4 



42.1 

7.9 
i7.1 , 

9.2 

0.0 
21.4 
23,7 

31.6 . 

4.2 . 
45.8 I 
54.2 



38.2 



73 .-7% 
32i6. 
13.9 



2940; 

.3.5^ 
l't.5 
' 7.1. 

1.6 
19:8 
35.5 

37.1 
25 .0 
24.% 
54.6 



Number in Sanole 



,114 



374 



33 



571 



9 — Figures include only those \*io ^said Supported Work {prepared them to obtafti a re^l» job. 

* Multiple responses were permittee^. ■ ^ • . 

^ ' b/ ^ 

'k, ^,\- , Figures include ohly those who said there were things they did not. lijce about Si4)ported Work. 

Q . Multiple respoi^es were permitted. 
- ERJC> . ; * 



26% 



1 7 /, • ' * '« 


* 

' * . * / 


* • % 






' ; \ 'M 












? ^ i 


^1 ■ ' ' , ' - . - . ' ' * • 


TABLE K, 8b 










J ^' PERCEUTAgB of EXyEFOCMEHTAU 'REPORTING 


VARIOUS REASONS WRY SUPPORTED WORK DZFTCRED FROM OTHER JdBS 




'f ' " * • - 

. . . . *■ ■ 


VOOTS SAMPLE 








» 




. . . .Hcnths in Supported Work Job 








Lass than 3 . 


' 3 to>12 


12 -or oora 


•Total 




r ■ ^ - ' " V 

^ . Job Skiiii and*Attitua«« 

- .* . L«ikm.nflv skllJti or trmcW . 

> ^' 'P«v»lop'b«cWr wrK.-attit 

> ; OiWlop; Mlf rconfidsnos 


16.2 
0.0 
0.0 


25.2 
2.1 
1.4 


: " is.'a 

0.0 

0.0 


22.< 
1.3 
0.9 




K - Mori injoi^ablt 

Jr; " ' i^««JfnjSy«bLi work . 

' , ' of work 

- . - . JMii'r werk^ 
J " Har'dtr'-'work 


• 8.1 • ■ 

o.b' 

40.5 

"5,4 
8.1 


2.1 
0.7 
35.0 
4.2 
2.1 


4.2 

- "b.o 

• 27.1- 

" 10.4 
4.2 


' 3.5 

0.4 
34.2 

5.7 

3.5 • . 




' Progrifl/Supiirvisor 
i, ' > ' Mori 'inimvi^i in individual 

' Ho^iitUint* supervision t 
5 i -Ptogrwi rtoi-^poorly 
^ -Pzogram ruii b«ttar 

* Progziitt;riin diffttrsntiy 

' . LiI«d\tijo«« running progrwB 
'I Did not liloi t^ioM running program 

' . ^ Tallow Woikars 

f'^ ^fL^^9^ workars 

Ooas not lika fallow workars 


2.7 

2^7 
2I7 • 
0.0 
10.8 
0.0 
. 0.0 

5*4 - 

2; 7 
2.7 


Q.O 
6.3 
0.0 
2.8 
6.4 
1.4 
5.6 
0.7 
4.9 

olo 

2.1 


' 0.0 
- 4.2 
0.0 
0.0 
4.2 
2.1 
6.3 
2.1 
3.1 

'2.1 
4.2 


0.4 

S.,3 
•*0.4' 
1.8 
7.9 

1.3 . 
4*8 
0.9 
4.4 

0.9 
2.6 


. i. 

s ; 

' - ^ 


f ^ " Wagas and >fbrki(ng Conditions 
- ^ * • High waga ratas 'I 
i/\ ' Low waga ratas \ 
-.^Pobjcar banafits ' 
" , ' Batta'rTjanafits 
' Poorar working conditions 
- " Longac hours ^ ^ 


0.0 

'2.7 

' 0.0 
S.4 
0*0 
0.0 


0.0 
2.3 
^ O.-.7 
0.7 
1.4 
0.7 


0.0 

• 6:3 - 

2.1 
2.1 
0.0 
0.0 


\.0.0 
. 3.5 ' 

1.3 = 
, 1.7 
^ 0.9 
0.4 


A ?; 


^ otnar 


5.4 , 


0:7 


2.1 


,2.2 


i I 

<' 


t r*^ (Sgpxtprtad^Work Mot Dl^f5|y?int) ' 


(40.3) 


(26.7) 


(32.3) 


(30.5) • 




t"' ' Humbar in Saopla 




143 ' 


•48 


228 




' ' 

r Of tha axpariatn^s , 3 oarcant ware no-shows «nd 6 patcant v«ara not in tha orooraa 30 lays. 

Muitipla rasponsas wara ailowad. Figuras inelu<^ only thosa who said that Supeortad Work 
I' ' ' diffarad froa othar jobs.- ,^ 

t ' * ' * 
* 1 ' , - ^ > 

i . 4 • . . V 

** 




<< 

r n 

/ 

9 . 

4 -■^ 

liERIC 


\ -204 

.171 








V 















" . ■ . ' TABLB A.9 , 

^ ^ • ' ~ ** ' - * " - - ' • • • . 

' * e'i; . - - - . - • i . . • ' • * ' 

/ - ' PERCENTAGE WITH;: POST^^^ JOB, • : 

BY. REASON X^R LEAVING SUPPORTED WORK AND AMOUNT OF POST-SUPRo'lOTsb WOWC FOLIXW-UP DATA 

' * / ' . .' . ' • ' . ' ' ' 

(For lliose With Job, Average Nund^r of Months to First Post-pix>gram Job in Parentheses) 

- " C ^ : : : 



Reason for Leaving Awount of Post-Siyported Work Follow-Up Data Total - 

Sipported Work ' < 6 loonths 7 to 12 iiohths 13 to IB Bibnths > 18 wohths S^m^Xi^ 

Exliaiis te d . Allowable 

Time^^iii^^PtogramS/" 



To Take Another Job 

or Job Training 
b/ 

Poor Performance-- 



Other-£/ 



55l6 


■ 100.0 


100.0 


100.0 


80i0; 


(0.6) - 


" (0,0) 


(4.5) 


. (7.5) 


'(3.7) 


J" 

60.0 . 


100. 0 


91.3- 


94.7 


.90.6 


(o:3) 


(0.2) 


(0.5) 


(^.5) 


(1.6) 


33.3 


75.0 


64.7 


69.2 


.67.5 


(2.0) 


" (3.4) 


(5.2) 


(6,5) 


(5.4) 


86.7 


47.1 


62.5 . 


' 73.3 


65.5 


(1.1) 


(2.6) ^ 


(3.9) 


(7.5) 


(3.8) 



NOTE: The amount of post-Supported WprV follow-up data is the number of sionths between the tiioa the 
saiit>le^meiri:>er left the Supported Work job and the date of the latest month of continuous 
fpliow-up data. ^ 

•^Ot^is includes individuals not leaving Supported Work to take another job, 'to enroll in school 
or job training, or because of poor performance, but who either spent the maximum number of months in 
the program or exceeded the maximum calendar time for participation. 

^ This category includes those terminated because of conflicts with the boss or crew members, 
use of (Irugs or. alcohol, illegal activities or incarceration, absenteeism, poor punctuality, or low 
productivity* 

■^This inclu«ies reasons such as low pay and health, childcare, or transportation problems* 2 



CO 




' ' 


r 

* . , Months- 1- 


•9 . " 


. ^Months io- 


J* 

•18 


■ ■ ■ — ^ 

Months 19- 


•27 


>^ Months . 28- 36 . : ' 




EKt>eriiwnta^S'' . 


^Controls 


E)^riMental8* I' 


Controls 


Ei9)dti«ehtals 


Controls- 


Experiaentals''. 


..:Contr6l8^ 


# 

Hours Worked per Month 














- 






6 


.2.0 


47.0 


31.6 


40.1 


. 38..2 - ♦ 


39.2 * 


26; 3 


3328 






10.0 


"17.8 


11^2 


16.6 , 


12.4 


10.1 


'li;8^ ^ 






44-86 




15.4* 


17.8 


I3i7 - 


11.6 


* 13.1 


'17.1: ' ' 


10^4 - V . 




87rl29 


18.0 


11.6 


13.1 


11.4 


8.3 


13.8 


13:2. 






130-172 


27.6 


^.S 


15.1 


7.2 


14.1 


7.8 


*5,.3\ 


15^6-, 




173^216. 


.24.1 


. 3.3 


10.5 


b 1 


12.4 


13.1 


22; 4 


^19:5 . . 




217^259 


0.7 


0.2 


0.7 


l.iX 


li7 


1.1 


- -'2.6 . 


o.b. . 




' > 260 . 


0.2 


0.2 


0.0 


1.' 


1.2 


1.9 


173^. 






lAveracje hours) 

L ^ 


(120.5) 




( /U.b) 




|ba.7j 


/CO c\ 


(87:5) 


, (82;5) * 






• 




• 




* 






- 




((dollars) 




















0 , 


•2.0 


47.2 


31.7 


40.1 


.30.2 


38.9 


26.3 


33,8 




* 1-99 


9.3 


16.1 


8.3 


13,5 


.^9.1 


7.4 


7.9 


5.2 ' 




100-199 


13.9 


13.4 


14 .4 


.11.7' 


B.3 


10.4 


15.8 


5.2 




200-299 


13.0 


9.2 


10.7 


9'2 


5.8 


6.7 


" 5.3 • 


6.5 




300-399 


16.9 * 


5.8 


9.3 


5.6 


*i.8 


10,0 


7.9 


5.2 , 




400-499. 


32>3 0 


3.4 


a.5 


6.7 


9.5 


7,4 


9.2 


10.4 




500-599 - 


9.8 


3.8 


7.8 


5.2 


5.4 


5.9 


10.5 


11.7 




6U0-699 


1.2 


0.4 


5.4 


3.4 


. 9;1 


5.9 


7.9 


5.2 




700- 799 


0.7 . 


0»2 


1.5 


1.6 


3.7 * 


1.5 


0.0 . 


7.8 


% 


800-899 


1.0 I 


0.0 


0.5 . 


1.6 


1.7 


1,9 


5.3 


5.2 




> 9tK), 


0.0 


0.4 


1.0 


1.6 


3.3 


4.1 


3.9 


3.9 




(Average ik>llars) 


(340.0a) 


(124.39) 


(232.32) 


(193.76) 


(263.33) 
1 


(249.6^, 


(301.50) 


(336.76) 




Nuail>er in Savple 


* 409 - 


447 


410 


446 ' < 


^'i 241 


270 . . 


76 , 


77. 





NOTEj Sanples used are dofiiiad in Tabic II. 2. These data are not reyteiision-adjuated- Coliuans way not sua to 100 due to rouiiding. 



Months ^'. 9 . 


. :Mohth$ 


lb:- Id- 


" Months 19 :> . 2T 


Months '28Krr»36i 


*" • " ""^"'Perctat 


. Valut . . 


Percent. 

tTbtaiv^ 


Value 


Percent: 
Tbtail. 


Value . 


Percent*;* > 

'';;;o£r'" ' 


pyer.ali}Di|f«r«^^ ' • ^85.04** lOOiO^ 


12.17** 


100 ;o 


:2:00 




ai.sx 


iip0:0' 












t 






6,79 


55,79: 


I -09 




5:.28 




; Qiinge^^inv hours '-w^^ i . . 
;ambng\«JBpioyc<i^ ^ \39^,93 •I6i95 




:44.2X 


6i91- 


45v50: 


6.23 


. :54Vi3;> 



MpfZz The deccmpo'sitibW^o/ t^^ differential was estiaated >froi!i a tobit equation, in whidi jihe 

^ > -^verall-'di«^ 

r' ' / '^F^( • ) .+ :afg( • ) - X^SF^( • ) - af^( •) . * 

. - ' , . * ' . ; 

* ' . 1' ' . > . 

* whe re : X is • a; .v«ctb r . o f dbntror vkriables ; "3 , is ^a ve ctor of- es'tiinated coe ffi cients ; 

? ( da no teSt .the .cumui iti ve v.rw'nnii, - distribution evaluated . a t X ; 5 ([ ) denote s the, 
probiU3'4Xit^/'<^nsity^ f^ a is the standard error of the 

equation ; .ind C . and; c- deno te e )qpe rime ntals * and contro Is * values , tespe c.ti ve ly . 

<» ;rhe two cbnpdhents, respectively, 9an'be expressed as : 

and • - V . 



''£U5'(Y)*F^(-) 



^ See McDonald and Moffitt (forthcoming) for a discussion of this decomposition procedure 



■A 




"1 
■4} 



174 



2^ 



4* 

V 

-tar 



" ^ Mbhtitt-^ . \ All Jobsr .r . '''^6tir^S^JB^p<^^^ :C6ntrol Gro^g^ Mean 











1? 'J- 




' 9*1. 








'2;9'3:/ ' 


\ \ 
3;;28 






w' 3!2i / 






13^15. 


3*26 


. 3.39 • 


^ - •. 

I ^' 


• 16.-18 


'. 3.46 


3.50 














3^82 


3.80 




3.89 


^ 3 . 89 , 


t ' ' 


» 


' ■■3;85< " - 


3,86,' 




28-i36 


3.45 


3^45 ' 












:.31-33 . 




3.49 






: ' 3.45 • 


3.45 



.3V20; 




NOTE:"' 



These wagfe rates ire cadc'uia^ by dividing the ai^rage monthly 
-eaiin^ I^??5) their:;.average monthly 

hpui& CTabler iir;4);. - ;Np 'si?pii£icain« tests were 



. / --'^No ihdivi'dua^ hive:^eeri in^-Suppotdted during this 

ti^ piriQ^^^ and\H^ias-w^^ on. ai-jobs^ ^ thos^ ph-hon- 

;;S|U{>pprt^vi^^ .joJ^f V • "^^^ are/^^^ is due ' 

either\to:i^^^ or to am occasional 

f^ilure^ for iridi?4'4^.i«^^ -^^^ bn schedul4 . / 



27 Mont ha of Uttta 



3G ; Hbhtlw ^ off- lUur:: 



•NbntKtt 



control 



' obntrol. 




!" ''/control'' . ' 



'1^1' '41 


31^; 75 


113.65' 


125;00 




,7*?^48 - 


98.00^ 


i42;60. 


,55-;46' 


82.66 


25.^7 


57;4*> 


72.^8 


44.17 ^ 


" 28^41 


52.11 




17.19 


57,43 • 


66;02 


-8.59 


69.68 


71.98 


-2.1b 


66.96 


81.96 


-15.00 


97.40 


^86.05 


11.35 








97.63 


90.02 


7.61 


89.23 


81.74 


7.49 



Ni«A>ar in' 



436 



298 



NcnS; SaHf>l6d arti deffined^t/ the length of posf-enrollaient period for Oiich continAoun cSata are available. |he8e data are not 

rp^reesioa-adjiiiited. Thus* results differ soMewhat ffro» those i-epoirted elsewhere in the report. No significance Usts 
^ Were cGHKputed. '"^ . ' ^ ^ 



12V 



KERJC 



r^a. aeans not «tp|>Ucablek 



CliTA,,.WlN« >ND OlIlliK I^UBLIC SEC1X)K. bHPUiyMfiNT 

: ' youiiifSAMPLG 

























.f. '' ' •* 




• '/ " ■ " ' 

Moiiths 1-9 


Months ib-ia 


. »tontha?19--2r -- , ^ 


w ... Mt>nth»-28' 


-36 . 




< t- > 

V-''« * 




Control 
Differential 


^ Coiit^^l 
Group 
Mean . 


Control ^ * 
Differential 


' Control 
Group 
Moan 


BxperinQntal'T' 

Control, 
bifferentiai 


'"•Control" 
Mekn *. 


^iBxpe'r iie i j ta IF 
, fobh trpi 
. :^ Differential 


\Cohtrolf 
^ ^ Group''* 
> Meant. 


^ - " ' 


' 

i ' 


• pGrdehtacie. Heporting Any 
CfiTA br.WIH job 


-2.4 


3.7 


. 0.1 * 


• h 

.4.1 


1.5 




-1.2 


7;4 . • 






AyQra<|6 -.Hotuhly ^Earnings. |:ro» 
CETA^o^ WIH Job (dollarb) 


-4.23 


7.57 


3.30 


.8.56 


3.71 


15.63 


-33.96 


55 .70 . 




1:4 


^ ,PeroQnta9e Importing Any 
, ^ Govurnnteii^ Job^ 


4!7 V 


8*4 


3.6 


14.0^' 


l.X 


11.9 


^ -lY.7 


21.1 


' 


* * ' Average Monthly Eamin^B . 
froM Ail GpvernMont Jobb- 
, t ( Jollars) 


-9.06 


17.36 


-0.01 ^ 




12*49 0 

4 


39.54 


* -82.85 


120.03 





NO'H;: 'itiese data are ni.«t regression- adjusted. No tests of statistical s&gnificance were co«i)uted» Jobs wore categorized according to, 
saiH>le MQiii>ers* responses to aubscions about whether specific jobs wer«^ part of special owiploynint prog«. t«s like CttA oc WIN and 
witether thoy were tOt states or local governnents. 



2/., 



'Itiese figures incluifc CbTA and WIN jobs. 



kmc 



'213 



.214 



- / 


y^: . ' 




. ^T^Honths of Oaca . 


M Month* of 64tA 


• 

•Months Xlfttr 
EnrollMnt 


. Contzol 


Contzol 


g3syrli»ntA>* Contxol 

Control Group ' 
i)i*f ftivsntiaX MiAa . 


-Cj^xistatAl? Coatsoi 
•'OohtroX % Gmp 



.16-W 

^ • 

28*36 



'13.24 



' A*. ^tiX CAzniagt 

'235.34, ' •7.*34 207.pi: 

n.A. 22.34 ,i44.4t 



'^.74 



•41.26 
-22.84 



126>i6 
^•6.80 
3S1.84 









B*. £AXBln9s Hot of CSTA «ad fOM EAxnings; 






16*16 




. 9.04 


224/39 


-7.78 


194 .52^, 


16.79 


^ 128.16 


W-27 




* ;: ' n.A.. 


n.A. 


18.09 


225,61'., 

$ 


-34.77 


271.99 


28*36 * 




1 

It.A« 


. n.A. 


n.A. 


•V 

n.A. 

r 


19.08 


,287.52 








EAxnia98 NAt of All ?ubUe 


SActor SAmings 


V . 




16*13 




3.79 


194.98. 


' -5.45 


157.83 


18.57 


99.37 


19*27 




n.A. 




-3.24 


204.67 


-25.26- 


239.82 


28-36 




n.A. 


n.A.*'^ 


n.A; 


n.A. 


75.94 


207.87 



HOTS: SJWlAs AT* dAfinAd by Itn^th of po8t-«ntolla8nt ptrlod for which teotia\kiu8 dAtm Art AVAilAbU 
' And ti}A dAtA Ar* not' rA9rA88lon-AdjaitAd. Ihui* rasultA dlffsr soMvhAt.frott tho8« nporttd' 
•IstwharA in ths rvpor^.^ Saa TablA A.14 f6r daflnitiottA of Aaployaant SActon. . Ko tigniflCAAC* 
tAAtA Wlbr* coqputiid. * \^ ^ 



n.A. atAns noc AVAilAblt. 



.16 



lUrtford 
York 







. Nonthft l 




HoiiUift 10 


- IB 


NontU IS 


- 27- 


- • . ^ • - 
l|bntlu^'2i 


- 34' ^ ' 


1 ■ > . - 


% 

* < 


'l:xp«riMiit«l-* 

Coiitrol ' 
.liiffercritiAl > 


' Control ^ ^ 
Group ' 


j(jip«riatnUl- 

Contrpl 
OifNrcntiAl- 


Control 
Group 


CuptriMntal* 

. OiffcrontUl 


Control 
Group 


K«ptriMnt<ilr 

'^-*:Coiitrot ! 
Oitorontial V 


ControL ^ 
'OroHp * 



.82.23** 
93.07** 
95.30** 
62.59** 
53.48** 



859 



35.63 ^ 

53.55f.:^ 

28.S5:^ 
•4^.78 

39*82 
^27.0? 



12.17**^ 
^.24 

11.44*^ 

-1.22 ' 
20.69* 
32.13** 



55.15 

73.05 
47.34 
. 73'.06 
61.64. 

^ \ 



2.00* ' \ 60.96 . 

-18.03*' 119.^*( 
4.13 4. 55.07 \ 



-11.44 

12.53- 
17.97 



i/ 



82.41 

29.03' 
. 38 J99 



657 



509 



11.51 



20.88*'. ^ 



7-9..82 i 
, 35.53* . 



\ 



153 



w 



71^63 



68.68*' 

9i.21 

34.57 



'^2 



Nai-SSx S«tt note to Table U1.7. 



^Saaple size is* l6SS' M><u» ,20. 



*::t:sti8itically sf^nificant at ilM 10 percent level. 
**^tuj:istically ui9ni*ficaRt it ilie 5 percent level. 



• » »» 



ERIC ' r,^^ 
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PERCOrrAGE »U\riNG JOBS. BY SITE 

YOUni SAMPLE 







.ikinths l^r 




Months 10 


- 18 


Mouths :l9 - 


27. ^ ' 


?Mbhttiss^6 *^ 










E]q)4eri«ental*' 

tCohtrot 
differential 


Control 
^Group 
Mean 


. E3q>eriMental- 
Control 
Differential 


Control 
Croup 
Mean, 


Experi»ent•l- 

^ Control 
Differential 


Control 
GrMip* 
. Mean ^ 


~^^^Exp«rijM^t§H'''. 
. 1 'Control;/: 
Differential . I 


trol^ . ^ ~ . 
^Crou|) 1 
, .-^Mean^l 




AUauU. . - ^ 




- 6.82 


3.89 


2.63 


.'O.di^ 




■ '^n.-a^ . ^ 








tlurtford ^ ^ 


.^-p:26 ' 


6.76 


" 0.34ff 


3.61 


4.26 


3;03 


; .... 




' ' S 




Jersey r'City x v.^ . 
N^i#.York; 


-6.71* 
•2.36 


7:69 ' 
5.97 


-3.77- 
1.00 


6;80 
3.23 


0.72 ' 
-14.29^^' 


9.41 
14.29^' 


-5.45: 

----- ^ 

.n.a. 








Pi:>iadelphi> 


-2.05 


4.55 


2.93 


2.63 


^ ,0.00 ^ 


0.00 


- ' 8.00 J , " 


0,00-. 




























Tucal 


-2.39 


3.65 


0.12 


4.08 


1.51 


4.87 


-1.22 


j ;89 , 






M/fE:^ These' data are based oti single subgroup 


means. Mo test statistics were cdaguted. 














Vsacple size is less tl 


lan 20.' 




















' II. <i. - not applicable. 










• 




/ .\ 




" , \!\ 
' - '•• -7 
* '< 

^ -i 
'■ -J 




* <f 


\ 


0 

















KerIc 



21 Q 



05 







. Hohths^l 


- 9'-....;... 


lkmt£s 10;- 


18- . 


. .rMimtlis; i9 


•/27C.-5.V 


...^ ,llQattiB'i26^:'- 






> • 


Sxf>erij»ental- 

rCohtrbl' 
- Differential 


Control 
'Group- 
Tuean 


^.Cicperiaental- 

Control, 
Differential 


Control 
Group- 
Hean 


Eiiperiawiital- 

.Control' 
Differential -! 


;Cpntrol- 
* Group' 


iCj^MriamtalfT'' ^: 

" i-^OMltirbl:;;^ 

. biffercWat 1^ 


' Control^; ' 
*^CrbiM>f ' ^ 


; ^ - ^ - ■r^,> 




•5.23 


llvil . • 


12.69 


18.42 . 


^33:33^/ 


16^67^ 




^'.niVi./ ^ 




litrtford 




3.37 


-2.23 


9,.49 V 


3.54 


6:7.7 






e..' .■ -In' 


ji^rscy. City 




15.89 


-17.88 


25.96 


. r 0.07 


21.18 


-20.91 






li<;w York 


-10.89 


15:71 


-4.86 


16.13 


•-28.57*' 


- 28;57-', 








Piaiadelphia 




6.67 


2.43 


2.70 


r5.41 


5.41 


3.65 


';4i35: ' ' 






-4.68 


8^43 


-3.58 


13.97 


1.14 


11.94 


-11,72 


21.05 





m/fe: Tliese data are based ott siaple subgroup neans. No test statistics were computed, 
-'saaplc size is less Cli4ii 20. 

r 

n a. = not applicable. 
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-WORMED' PERjWN'ffl 



Ail Yp^Uti 

•sitf. ■■ 

.^jtimta'..^ 
, Hartford 
Ji way' City 

Philadslphld 



Obiarvadf 



:k>ntA«--ld«X8^ 



Months 19-27 



•Mo 



Obaarytd! 



No- 













. 13.2 




1 is ^ 




.-7.4. 


-15f.-5^ 


-9.i^- 


11.9 


12.0 


■4;-9-' , '. 




r6;2 


4.3. 


-11. 2< - • 


2.8 


• 22.-5; 


22.7 


21.2 


21 i2' • 


•'30.7 


30.7 


14 -.3 


l4.i; . 



NOTE; For sample definitions ^ see Table: 11^. 2, Veiry few;-eiqperi^^^ 

received, unen^lpyinent coiqpeMatlo^ diiring the ifini:: ziine hiohi^ 
after enrolling in ihm demonst^»t^ and^ diiring: -the. .28-* to 36«* 
month period after ezirol]^ Therefpra^ no adjusted^ i^i.gures 
are presented for either o% th^ ti|Qe, periods* Thn estimates . 
asstimihg no UC receipt aM;^based o|i a cptnparisdh of hours worked- 
^ ' by e:qperiinen,tals vrtio did^^no^ revive UC and controls^ ^nce 
we found no evidence that l^ri was any significjBmt^ b^^ . 
difference bel^en the OC Mcipjyim and nonrecipiehts^ based on 
either their 1- to 9- or their 28- to 36«mpntii. enploywint. 

Significance levels for. thft^^above differentials .were not calculated-* ^ 



^ <7/ ' > ''.TABUS' A.;20. 




¥P^' • * / • 


. . ' ^ — 


o ^ 

Sasp^ wi U>; 1 8rMont)»3 p t 
;/fevi^5;:.Ui;0^ta 


Siui>ie .with 27 Ht>nt^^^ 
': :^/lr\jiroW-li Data" . \. 


Sanple^vfitl^ 36^H6nth8 ;c|f 






In' -^--^ 




-Ei%>ariM3ntal^ 
, , . ' Group . - ^ 


;CO|otrol 
. . Groups 


Expe'riaental 
- Group . ' . 


"ConJ^rpl 
^Group . 


-ExperiMentair" " ^' 

fvsGroup'^ ^.^.^..1.^-. 


Vjpontibi' - 
..,v.GroiS>vv 




> 


V = > J. .* 




3.6'' 


^ . 
3.7 


3.3 


3.5 








■ "-['(^ 




Nlniii9 . 


• b.o 


0.0 


6.0 


;p.9 




:ov6. ' 










.8.2 


9.2 


7.7 


:6.2 


6;7 










,N4iiiuf4icturin9 


30.9 

1 


25.0 


'26.4 


26.6- 


26v7 








1. ^ ' 




10. 0 * 


8.5 ] 


XI. 0 


4;4 


13.3 






- ■ ".*>>^ 




,3llK>i«|iiU Trad» 


. .0.9 


1.8 


4.4 


1.8 


0.0 


f.O • 










20.9 


24.4 


17.6 


?7.4 


20.0 


4'4v3^ 




^^>^":^| 




Fiiiaitbei thtturanoe, «nc! Haul KstJita 


1.8 • 


3.1 


3.3 


6.2 

» 


. 2.2 ' 


6;0 






i 






24.4 


26.4 


23.0 . 


26.9 


16.3 








(65.8) 


(78.4) 


» (74.8) 

. . 


(82.8) 


(90.3) 


(93.2) 






\' 


. NiMber .in Sawpla 


t 

110 


164 


. ; 3 

91 ' 

t 


113 


45 


49 






i' > 


NLrni; Saiif>les are da fined aa noted in Table 


111,9. Ilie data 


are not re9rosBion*-ad justed • 













/■ 



/ - 



-, ^ 



• 223 



- yputii'sXitt*te 




Siiii|>U withaS-NM^ of 



:Oc»ntKol 
GroUp 



Honths of 



ExperiMsntal. 
GtOMP 



Control' 
> Grbiip . 



a>; 



citricai or.SAles 
V Agricultural Hsiiing, fbrubtry, jpr Related 

B^ncliWork ' ^ 

Structural WoVk 
Miscellaneous 

^ (Perottft't with Non-Program t:ii|>loyMent> 



3.4 

16;! 
22.0 

0.0 
' 8.5 
10.2 

9.3 
27.1 

(65,8) 



4.7 

19.2 
25.6 
2,3 
^ 4.1 
8.7 
4.7 
14.5 
*16,3 

(78.4) 



2.0 

io/o 

29.0 

1.0 
10.0 

7.0 
15.0 
23.0 

(74.8) 



0.8 

. *31.1 
4.2 

1.7 
5.9. 
5,9 
10.1 
21.9" 

(82.8) 




(90.3) 



(93.2) 



/ S 



Number in sample 

- , c - 


118 172 . • \00 




119 . j ' ^ 


\ 

51 


S3 














•NOTK: SaMples are dafineU as noted in Table III. 9. 


Hie data are^not regrttssion adjusted. | 


• 








• 














. 5; 



. :\i ^N^t' 



' ; TABLE, ..A. 22-- • . . ■ ^ 

G FIRST NON-'SOTiPlDRrEb WOSk JOB FOR VARIOUS REASONS 



Job/:Chari'ct»risti:ca/^ / 



Problems-/ Obtaining Oiil Spare 

■ • ^ . ■ vi:-"' ■ • -■ - V 

.. . '■ ^ r. ■ 
Poor Perfornoncei ' 



Lack of Work 
Did Wot Want to Work^ 
Other 



Controls 











39.0 


, ' 30.6 


11 9 


13 ^ 


n*a« 


n .a . 


2.5 


■ '-2:6 


5.3' 


f.O 


50.4 


35,6 


^8.1 


' . » 1.5 


14; 6 


11.6 



Nunber in 'Seutple 



267 



. 271 



MOTB: The ^sample include^, ail saspla youth v^o conflated at least an 

anroliment, a 9-ncmth, arid an 13-snonta intsr'/iew and '.vho, had held 
^. at leaat one non-prpgram job which 'they left' during the follow-up 
pieriod. * ' • 



;:ERIC 



185 
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^UBok^rbRCc STATUS j6«: sisiMiCH 
,ti«l|j^T;(^ i«e^ iNVaesfEaivc TiNK 

YOUfm SAHFli 



^ , 00 



Control 
DifforthtikI 



Mort jlha 1 - 9 



Mouths '10 - aa 



. UnM|>loy«4 



PciWiitagt looking for work 
With help-of ' • - 

State ci^loyM 4\gency ' 
-iCBTA' "\\ 
- CoiMMmity'or^atiization 
'Private 'a^ncy 
«otiier 

Average ^liuMber of contacts 

llciirs p«r.week spent looking 
for wrk 

R< nervation wage 
{(klla'rs per' week) 
Aaoiig ihbse .employed 
AMong those, uirveaployed 
Aitoiig. those not in the 
labor force 



Control 
.Group ^ 
i^Mean 



Months 19 - 27 



9;42** 
, 28.17** 
-28:i7** 
-9.42 



71^66 
42.44 
57:56 
28.34 



Kxpariiitntal- 

Cohtrol 
Diffarential ■ 



Control 
Group; 
.Mean 



. Monttis-2a 



KjqMriacntajH , 

Control' 
Oiffaraiitiai . 



Control' 
Ofoup 



: Kiqptritttntal^ 

. ' ^Control 
Oiffarential 



ytrontroi/ 
/droupV 



-3.36 
1.53 

-1.53 
3.36 



76.35 
.^2.80 
47.20 
23.6^ 



-4.44 

2.52. 
-2.52 
4.44 



75.75 
56;65 
•43.35. 
24V25 



5;25 
r2;56. 
.2.56: 
-5.25 



.46:75- 
100.00. 

iOfSO 
53:25 



-_ >^ 



-11.35**^ 


57.43 


-0.32 


51.10 


55.92 


47.93 


^ 5.88j^ 


\ .42;65-^ 




,0.79 
-11.55** 
-3;80** 

0.52 

2.56 

3;. 88 


0.87 
28.02^ 

4.35. 

3.90 

1.29 
87.83 


t 1.04 
-5.V6 
-0,70 
-0.57 
-1.01 
3.15 


0,00 
34.93 
3.83 
6.22 
6.22 
86;52 


^^o/ik) 
-4.35 
3.53 

' -2.18 

2.67 ' 
3.15 


0.60 
47.83 

•5.17 ; 

8.70 ^' 
6.03 
87.07el> 


0^66 
^ -14*85 
-13.79** 
r3l87 . 
-0.42 
»^ -4.39' 


\ OfOO 
48.28 

1S.79. 
6.-90 " 

86.21 r 


. 


0.05 


2.45 


-0.23 


2.82 


-0.65 




-0,16' , 


- 2.09 




-1.44** " 


4.46 


0.30 


3.76 


' i 
-0.45 


3.65 


-1.24 


3.82" 


V ■■a 


14.90** 
15.98** 
9.57**. 


107.81 
111.24 

^Ollr^O 


5.02* 

5.05 

6.11 


124.91 
129.25 
119.84 


^ * 10.99** ' 
* -1.51 
14.65** 


13^.42 
144.65 
120.17 


10.42 

12.13 
' */ 


138,44^ 
146,00. 

[ £/: 


1 ' " ' ; 


11.48 ' 


109:73 


3.47 


J24.87 


26.55** 


123.30 




13^i46 





\ Ml'- 11^: Thtiso data are luised oii .likHilju &ub9roup »eaiis. S^les used arc defined in Table XI. 2. 

. ^Ther^ were no contro^l-yroup aanbers a«ohg the uneaploy.ed. , • 

A*Jt^tisttcally sigfiif leant ac the 10 percent levels f 
O ^^'Stiitistically significant a^ ^ « • 
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Controls Crowp" 



:Wbnthrr2a^*.34>,>.> 
EKiMriiifjf^ti^- Control 



9 Control 
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Public; IkHuing 


. Ollfcrctitisl* . 
-5.8** 


Mesn^. 

,22.6 
32.6 
6.9 

• 


Oitrercntisi <^ 

-5.1 ; 

O.l 


;24.7 
30.9 
1.4 


-6.7 

• -lis 


22.2 
30.7 

2.9 « 


, -5.0 
-3»3 


' 2i.O / 
27.1 . . 

3\^3 ' 
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AMOUNT OF IN-KINO ASSISTAIK^ RfiCClVSD 
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YOUTH SAMPU 

t 








** 


♦ 


Months I « 


. * 
- 9 


Months 10 


18 


Months 19 


-*l7 ■' . 


Months 28 - 


36 


% 


"^SxpevUMntsl- 
• Ccutrbl ' 
Oiffcrentisl 


Control 
G^oup 
Itesn 


SiqMrjlMntsl- 

Control 
Diffsrcntisl" 


Control 
Group 
Mcsn^ ' 


EspcriM^iUil- 

Control 
a)i£tsrsntisl 


Control 
Group 
Mssn 


8SpS • * 

Control 
Diffsrsutisl 


^Control 
Croup V 
Nesn . 


» ■ 

NiKber of Months with 
litfdicAiU CArd 


-0.6** 


l.S 


. 9 


1.6 


■ -0.3 


"» 

1.7 


-0.6 




Mi«iUei- of s'ubsidirod Doctor 
' VisiU » y '^'2 




O.l » 


« 0.5 


oa 


0.2 


-0.1 


0.-3 ^ ' " • 


Ntiu>er of Subsidizftd 
« JUispita^ PAys 


-0.2 • 




X) 

^0.2^ 


0.4 


0.2 


.0.6 


' 0.0 


0.2 


Moi thly Public Housing 
Vent (doiisrs)Br 


U.9J** 


109.64 


5.48 . 


118.02 


2.15 


120.31 


18.52' 


* 101^38 


'•'l<0«>chl/Rent Subsidy 
iJolUrs) ^> 




1.04 


0.31 


1.66 


, -1.18 


2.92 


. -5;70 


5;70 



-. m 



^ ^ ^^.r, ^ i« -..hi. \\ 2 TiMsa dsts sro siM>ltf subgroup Msns; •scopt 'thoss /pertaining to 

' -ur^wJ5S.':"'lt,r:.""-.aSi-i^^^^ Po^?.in f-U --pi., not ooly to r.clpi^t. 

. 2/a r«.nt iu^-id^ is d««»n.«J «« •^•n' P*" «»i"ctly t° landlora by th* walf.r. •9«icy. ; , 

fe^thoso figurss apply only to 'public housing rasid4ints*^ I ' . 

• t ^ • . . \ • - 

O ' •L.atlsticslly-nignlficsnt St tiMi 10 percent Icr . ^ 

[^(^ MSististlcsUy significsiit st ti4i 5 porwmt Isvs;,. , . ^ 
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TABLE :As2S . 
PERCeNTAQi^i^ ARREST 

. . tybmK^AMPu: 



If 



* 


Montiw i - 


9>1. 


NoiVths 10 -> 


18 


. Months 19 


27 


Months 28 


- i36 




Sxpecinehtalr' 

Control' 
. Differential 


Qontcol 
Hean 


«Experi«ental- 
Cpntxol 
DiTfei^ntial 


Control 
Group 
Mean 


Experinantal- 

Control^ 
Differential 


Continol 
Grotf> 
Mean 


Experiaehtal-^ 
Control " 
Differuntiai 


control. 
'Group 
Mein' 






19.9- 


4.0 


*19.1 


3.8 


10.4 


^ -19.0 


44.6: * 




-0.0 ' 


17.0 


-0.4 


14.0 


-8.3** 


17.2 


. 17.4** 


4.0 




(45.0) 


(53.0). 


(8.5)** 


(59.9) 


(l-O) 


(60.8) 


(7.5) 


(66.2) 


NOT£; For definitions 


of tlie samples used/^ 


see Table 


IX. 2. Thes6 dAta 


are not regression^adjusted 






- 



00 
00 



^Theae.data May differ somwhat fro« those reported in Chapter III because of the sliglit diffenin^s in the sai^iles used and 
e Uiese data are not regression- ad justed. ^ ^ 



^Statistically sj'gni f icaiit at the'lO percent level. 
^'Statistically sign! II cant at the 5 percent level. 
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Hontlis 1 - U 



All Youth 

SiU 
Atlanta 

^ eteriford 
. Jersey City 

riaiMklpliia 



Kspftciatntal- 

\CMitrol^ 
Diffarantial 


' Control 
Croiif) 
He an 


.014S 

< 


.3170 


-.0249 


>1630 


.0733 


.3423 


-.im 


.3301 


.1427 


.3527 


-.0S38 


\316S 



Wontlia 1 ' 27 
Ki^MriMintal* Control 

Control 
PifforoPtiai Wean 



.2012 



-^.5155^/^ 

.0196 
-.250aj 

.5620=' 
-,1745 



.5606 

.6664 
.1469=^ 



NtiaiMrr in Sanpla 
Hcan Nuaber of Arrests 



^9 
.434 



379 
.660 



H^n^i Saa^ies us«kI are defSju:cl in Table 11.2. 

aaaiae siie is I. bs than 20. . Thus, tlieae point estinates'of experiaental-conlrol differentials tend to be quite unreliable. 

^Statistically significant at tlie 10 percent level. 
*^SUtislicaliy significant at the 5 percent level. 
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ASSESSING THE IMPACT OF 
•INTiBRVIEW NONRESPONSE- OK 






.EVALUATION RESULTS 

• ■ ■ — % 
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By R«ndaii Brown* ^ i{ ^ - 
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This appendix is excerpted '^rom a project .report "Assessinlj^ Sie:^E/£acts 
of Interview Nonresponse , on :Estisi4te of the Impacr of Suppor^gd Vprk/' 
Princitori/ New Jersey: Mathematica Policy Research, Inc.f 1979'. '' / 

, ^ .. . 
\ ' 


^ 

/ '* ? 


i: ^ 


' ^ . % - 


' ; :!e 
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. ■•Thf*jpt;|jw^ th«. ffftcta of 

't^f; SiHppo'rt«d\W6r)C';pra^ .thti. ;flh9l«<':tq<M :ttuitipltt.<re9rsssion 

^modtl'.. iln th« :siiqpl«tt da<«r outcbmit: 6i:iJii^^ (such as earnings, 
:t«j^io>^nt/ ani dr^^ ar« .T,#9r«ii«it and 
' on 'a'dinniy iViurlabl«.^«^ for. aiotrliMniuls. and zero for controls. 

TJW eoifficittit. oh iAa,-ajfpari»ntal stat^^ rafledts the difference 

vbetwefn-ej^ieriaehtai and controls, while the other explanatory, variables 
l:-'.- acc6Unt ,for differences in the other characteristics, so that the" cbnqparison 
of;,experiinentat and control grpuqps; is^for groups with similar con^ositioni 

> * 

Alternative Specifications include iritiract ion terms between the 
ejqperimental-con'trol dwmny and personal characteristics, in the belie/f^ 
.thai .the proaram's intact may depend tqpon the socioeconomic characteristics - 
of the participant* Inttractioni of tha asqjarimantal aitatus variables 
with location dr length of aite operation may also be included in the model 
as explanatory variables. The general regression model can be written as^ 



V - X9 + c, 



(I) 



where Y is the. outcome varijible, X is .a matrix' containing demographic and 
•socioeconomic characteristics as well as program variables, e is a distur- 
bance term, ind B is a vector of unknown parameters to be estimated. 
. . ' ' 'latiaaticn of 3 is jasually aecomplishdd by the -ise of ordinary 
least squares (OLS) reg^aMion methods, where the OLS estimato'r can be 
written/as: 



(2) 



.Subsziratitng (i) intO' 1.2) we have 
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3 « 3 + (X'X)"^ X's. 



(3) 



For a twpri fri, which no tyttiMMttic •f^tct-is op«r*tting. to Xiait th« 
MkapU Ay«ilabl«" for :*njilytis~tHiit- i«> 4n, uncinsQr«d Jaa^jU— th« 
•xp«ct«<i- valut of th« r«^««*«iph .co«f f ici«pt is , - ' ' 

" E (8|X) - 8 +■ (X'X)-I X E (e|x) . (4). , 

ThuS/ 8 1« «n unblM«d •stiaiator of 8- if E (t|x) • 0; that i», if the 
conditional m«ah of- th« disturbance- ttra ii equal' to' taro. This 
condition i« usually esauiBed to be satisfied for a properly 'specified 
modeii . . , 

For a censored saa^le/ however/ we have-the additibnai; condi- 

tioning factor 'o£ th% *umpl% «tl«ctioh. rule. Hence/ ' * ^ 

E (B|X amd selection rale) « B + (X^X)~1 X E - (5) 

(e|x selection nile) 

If the conditional expectation of the distixrbance tern^fails to equal 
^2%ro, the coefficients will be biased. Thus, attention must focus on 
^the relationship between the sample selection rule and the disturbance 
tent £• 

The censoring mechanism in the case under consideration here is 
failure to obtain a scheduled follow-up interview {for any reason) for 
an Individual. One way to view this mechanism is to imagine that each 
individual has an index of response likelihood/ R*. Individuals with 
value's, of R* exceeding zero will be locatable and will be able and will- 
'ing to complete the interview. Those with values of R* below zero will 
not complete interviews,. Furthermore/^ assume^. that it is possible to 
identify some characteristics that affect the likelihood of response. 




—V. 



such..as-whttiier/^t^^ mbvW^ wfiither he or she is incarcerated, 

arid-a var^tjj- W other person^^^ traits. This model can be described as 



where Z is a ve'ctor of personal traits affecting responsiveness, V 5 is 
th« do«££iQi«nt v«c'tor, and n is a distiurbance term. Of course, R* 
is no^ observed diracily; w« only toiow whether or not an interv-w was 

coB^pleteid:= . < " . 

V. r 1 for R* > O", (i.e., n>- 

R - < / ~ " 
'(O flbr R* < 0, (i.e. , n < - 



- Z6) 

, (7) 

Z5) 



where R 1 for respondents and R « 0 for non-responders . 

' From equation (5) it caii be seen that in order to obtain 
unbiased coefficients we require J- ""^^^ . 

E (e|x, T] >' Z6-) - 0. (8) 

* 2/ 

If e has zero mean and e and n are mean independent,- this condition 
is satisfied (for nonstochastic Z) . However, if the probability ^xjf 
nonresponse' is affected by Y (and therefore by e) , e and n are not 
independent, the expected value in equation (8) is not zero, and the 
regression estimates of the coefficients in equation (1) will be biased.- 



3/ 



i'^The -vector Z may contain many of the same variables as X contains. 

iWn or conditional* independence implies that E - E (£) , • 

~ a somewhat stronger requirement than zero correlation, unless £ and n are 
assumed to have a bivariate normal distribution. 

^fa .noted by Peck- a973) and others, li the probabiiicy of non- 
^Msppnse is related only to the regressors (X's) or is random, no nonresponse 
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This correlation .betwein- S and -n-may "resultr in two different 
■ vfays. "If 2 contains only nonstochastic variables, and' there exists an 
, ' unmeasured variable (e.g., motivation or attitude) that affects both 
outcomes, and the probability of Response, thet> £ and n will be 
correlated. However, correlation,'o£ the disturbemce terms of the 
estimating equations will result even if the disturbance t-erms in the 
structural equations are independent if current outcomes affect the 
probability of resppnding to requests for interviews. In this case^ 
the structiiral response model can be written as 

R* « X6j_ + 2*62 -i-.Yi^ + n*, - (9) - -.^ 

where Z* contains, exogenous variables not included in X, and n* is a 
disturbance terra possibly uncorrelated with t.^^ Substituting equation 
(1) in (9) to obtain an equation that can be easily estiaated we have, . 



R* - X6j_ + Z*6^ + (X8 + 2)62+0* " (10) 

- x-(6^> 86^-) + 2*62 + (n* + eS^), 
R* « z6 + n, ^ (11) 



,v- 



where Z » (X,Z*), ^ + SS^N , and n » (H* + tZ^) . 

Clearly, the disturbance term in the estimating equation (11), which 

has the same forn as equation (5), is correlated vith even if" ths 

2/ 

' disturbance terms n* and s are independent.— 



i'^Some of the elements of &^ will be zero if there are variables 
*in X which affect outcomes but not response. 

2/ 

The only difference between the two behavioral specifications 
that affects estimation of the model of probability of response is that 
equations (9)'«(11) result in cne inclusion of all exogenous varieioles from 
the outcome equation (1) , including ones not considered to have direct 
impact on the likelihood of respoiise* Only variables , directly ^affecting 
O resoonse- are included in the vector labeled Z under the first specification / (6) 
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Figure B*l provides an intuitive explanation of the problem. 

"•^ ' * * * * • 

For e given vector Z, individuals with l«u:ge negative values of n are 

more likely, to be nonresponders. JEf n and e are positively correlated, 

the nonresponders are more likely to be those with' large negative 

deviations (€) from the true- regression liner ABr-that is, those 

corresponding to the circled points in the diagram. Performing » ; 

recession analysis on the restricted sample would produce a(i estimated 

regression line like CD. Coc^arison of* CD with the true regression 

line AB demonstrates the potential for bias in csti^bs^d coefficients 

arising from nbnresponsf^f. 

Recent devolopmer%tij in econometric methodology suggest ways of 
handling the problem cf nontosponse bias when data on the variables affecting 
the probability of rcr.pvr.Sft (z) are cbgerved. Heckman (1976) shows that 
statistical models chara.. ;<^ri3sed by iimit'^d dependent variables, sample 
selection rules, or truncation points have h common structure, and 
.suggests a single method of estimating these models th^^t we employ in 
this analysis. • * . , 

Hecktnan's paper deals with the estimation of models like those 
specified in equations (1), (6), and (7). In an feariier paper (Heckman, - 
^1974)^# he showed that maximum likelihood -methods could employed to 

V 

i 

consistently and efficiently estimate the parameters of th^s model. 
However, the likelihood method was found to be quite axpenilivo. '"he- ^ 
more -recent paper (Heckman, 1976) shows that consistent estimates can 
be obtained in-a much less costly manner by treating the problem 
-as an "omitted variable" problem. Using our nonresponse model to 
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-lliUSTRArap EPPE SAWLE ;Npi^^ ESTIMATES 

pp; .REGRESSION >ARAMEra 



• Tmm Rtgression Lin« 



•stinatihd usln?. 
data' on- raspondtrs 

only . " . 




Nota? Cycled obsar vat ions are those omitted from th6 evaluation 
saunple because of nonresponse. 
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:d#m6hijtrat«> this aqtiatioh. (1) for tWt i » 
oburvitlon is. • * ^ ' ^ 



T^ing #xp€ctations, ^l^«iv that thfi sampla! available is limitfad ^^o 
' \ ^ E (Y.lRi >'0) - X,9 '^t (£jR%-0). (13) ' 



If wa assuma that s and n# thi 'disturbanca tarm in equation ,(6).i 



1/ 



follow, a- bivariata noraal .distribution , .then it can ba sho\^T that 



2 (; iR* >o).i,!ii-, ^i' . (14)* . - 



wh«r!i -Cj^, is the covarianca batwaan e and n, is the^ variance of n, and ' 

< ■* ' ' • ■ it 

-. ' • X, K--^'. "v (15)- # 



T?i« danominator of X. is th^ probability that R^. > 0 (i:e., the ptobabiiity. -i'^' 
that tha individual rv«sponds to the interview), whilo the numerat:or of » ; 

* ' • ♦ 

is tha standard normal density function, evaluatti, at the point '^^/^22^h 



Substituting equation .(14)' in equation (13) we have 



s (y,|R* > 0) " x.is * ^12 \.: 



Estimation of equation (12) on the sampla of respondents will 
not take .into account the final term in equation (15). Thus, tojrfbias 
that, arises from use of. thiV"c«ft«oJ^*4" sajftj)la%exis« solely ||^use_ 



i^See Johnson and-Jtotz .(197.2)-^^. ^^^--^^-^ : .'f%<W^'>^'. 
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. "thr -condition*! Wfuh of e^.iii o«itt*<i f rom 'th« r«gf«i«ion. Tht bia* 
th*t i:*«Mlti «»« '0^ may th«n bt intfrpr«t«d 

•«f; arising; fro© Mp%citic^tion 3txdr. Thii inttrprttation 

, suggests a liinplt loiutioni provide an instruintnt for tha missing . 
^ VariabU: (X^) .^d aitiM Hackj^ah;, (1976) proposes j^ust-.^ 

^ this> solution to general prbbiam of salliction bias;. His approach • 
(appliiid't9, our:8iod suggests 'that if data on 'the^ variables (Z) 

deter!^ning the UkeUhood oiTrespo are avairable, a.* approximation. 

' * ^. ' ^ . ' ■ ^ ' . ' ' ' ^ ' 

to can be obtaified by eetiaating a probit model of reoponse, such ( 

' . ' • • . ' * • 

a^ that implied by equations (6) and (7) l and then using the estimated 

''coafficients to form X for eabh observation* Equation (16) can then 

be readily estiviated by ordinary least squares regression. Although 

tha^ equation stiH mus t >e fit only on data from respondents, any bias 

-—that-this-^might .impart'^ to^tJhe 8, is corrected for by 

N ^ 1. * ^ ' ^ 1\ 

inclusion' of the X^ term,^'^ cif , the assumptions of- the model hold and 
X is reliably as tijnated. 

.... ' • - • 

For^ this study, m are interested only in bias in the coefficient 

measuring experisiental iaqpact*. Adding X to the estimating equation will 
J Change our estimate of SjAported ttork's im^^act only to' the- extent it hat 
X is correlated with status. HeHce/ wit .shall be particularly concerned 
,with those cases in which experimental status affects tke probability 
of response. * 



— The estimates of B arc unbiased only, asymptotically/ since 
; an estimate of X-. must be* substituted for thei unobserved true value 
in the regression i - ' . ' ' 
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:In th« nt xt s«ctlon# a wodml ^ •xplaln rMpons« 't9 Supported / 

work intjirv4,-«wt is d«v«lop«d, .«nd th« <riMttl«« from this •stimation ar« 

• ' " ' ■ \ . • . 

' us«e/in th« final section to iaplsoMnt Hadtjum's -approadi to cbrrac't 

' for f«l€ct'ion bias. 

' . . ' / ^ 

ZI.' A MObEL OF THE PROBABILITY ~ CP RESPONSE TO SCREIXJLEO INTERVIEWS 

. Tha probability that an inaividual will raspond- is assUaad to 
dapand upon.-hiS'or har daaographic charactaristic/ pas't and p'rasant ■ 
bahaVior^ and asqparianca with tha anrollaant- int4rviaw. 'Hhila this, 
includas many of :tha sama variablas that ara. ig^ortant co:\trol variablas . 
in tha outcoma ragrassio'ns, aquations (9)-(iy suggrist that all -variablas 
aff acting outcoaias should, ba includad in tha rasponsa sodal, avan if thay 
ara fait to hava no diract impact on raspohsa ra^jponsibilitia's. In 
addition^ a .nunbar of variablas that ara/assumid hava no Intpact on 
outcotMs but that ara fait to aff act th4 probability of rasponsa ara ' ^ 
Inoludsd In tha mdal. Exanqplas -of such variablas are tha nuinbar of ^ 
moves^mada during tha two-yaars priot to anrollaant. (slnca thosa moving* 

ara of tan tha hardast to locata) ; soma variablas dascribing personal 

* 

living arrongamsnts; axpactsd earnings if eo^loyed; whether the indivi-*. 

dual applied to Supported Mrk because of some agency pressure to find 
*a job; some^ indicators of the natiure of the interviewing process itself/ 

such' -as' the length and location of .the baseline interview; and \:he . 

individual's degree. of cooparativeness cotspleting the tnrollisent 
^interview (as reported by the intarviewer) . . 

Because the data on these deterziiinants of responsii are collected 



from th« •nrollmnt lncttrvl«w, ^•\paramattrs of * the model of^ response 
to the follow- interviews can be estimatetr* Prom equations (6) and 
IV , assuming n has a standard nomal distJMhutionr ve have ' 



P .<R^ « 1) « P-(R^ ^ 0). 



p (2^6 + 1 0) 
p (n^ < z^6) 



— f 2 

J exp (-n^/2) dn^. 
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Forming the likelihood function for- the sample gives 

i 

. . L - [P (R^ - 1)]\ [1 - p (R^ « 1)]^"\'. 

• « 

Estimates for ^ the parameters of this probit raodelv 6, are those^values' 

r ' , tiiat maximize Aif and are readily obtained from a probit computer program 

' r Senile! sizes used for- this analysis and for the subsequent 

. ^ regressions te/ estimate the impact of nonresponse on the evaluation 

^resulta^^^tre shown in Table B.l for each time period r.nd target group. 

The number of observations avatilable for the 36~inonth analysis is quite 

small and therefore may be of limited value/ but for other time periods 

sample sizes are generally adequate. 

Response equations were estimated for each time period. The 
• ft 

restfLts, presented in Table B«2, show that sex/ race, living arrangements, 
and length of longest job were Importemt determinants of nonresponse for 
^ thji^ early interviews and the 27-month interview. Females (who made up 
10 to 13 percent of the sasqple) were more likely 'than males to respond. 



TABLE B.l 



SAHPZi- SIZES t)SEb. IN ESTIHKritiG 
BESPONSE MODEL AND IN REGRESSION ANALYSIS 
(Rasppnsft Ratec in Parenthasfts) 





' ' Months 


Months 


Months 


~ Months 




1-9 


10-18 


I9- 


■27 


23-39 


Nonrassonstt Model . 




1/080 (69) 


60 2 


(71) 


"in (79) 


Respondents 




750 


. 430 




130 


Npiirespondents 


* 


330 


172 




28 


Outcome Regressions^^ 


709 


- 687 


390 




90 



NOTES: The numbers of respondents differ from the sample sizes used in 
the regression model' because of observations with missing .data 
on the specific dependent variables examined* Although these 
observations are also lost to analysis and thus could be consi- 
dered nonrespoiiders/^it i» unlikely that the same, model applies 
to both interview nonresponse and item nonresponse. Because 
missing data items could result from several causes (including 
coding errors) and because the number of respondents with 
jnissing values for the desired dependent variables is generally 
small/ it€^ hohresponse is ignored here. 

. \ The response rates presented here differ slightly from those 
, given in Table Pkz because observ:itions with missing values 
on necessary ba^eiine explanatory variables were excluded 
from this analysis. 

./ ■• .. ■ ■ ^ ■ 

— Individuals were classified as responders in the 1-9-roonth ' 
and lO-lS-month analyses only if they con5>leted both interviews. Hence, 
the sample sizes given in the column' headed "Months 10-lp" apply here 

as well. 

* b/ 

— These saiii>le ^sizes differ from those in the main body of this 
report because observations with missing data on needed baseline vari- 
ables were excluded from this analysis/ but not froa the main ar*-ilysis. 
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^ia. z»j^ or AKO 
fiiOQiuui vumus.ON ttt:>i^^ or nstotr^ 



9> nd H^Month 



follow-Up Inf gvltir 



27*«ionth 



36-Honth 



■VAtlAltJS ALIO diin-lH-OOTCQMg-^ 
iMMC o£'4U9«riMnt«l ^roup 

tUriford 
^•riiy City 

• Sducktlon 

(Uti thAii 9 /Mrs) 
> 9 ]rMrt 

A9« ' ^. 

• (OtwUr X9) ^ 
' > 19 

(Black And othtr) 
Whlt« 

Hitpinic ^ 

• Houtfthold tlx* 

Any w«Xfu:« prior y«Ar 
Any d«p«rvd«ncs 

Ttchnically •llglblt for own targtt grot^ 

Ungth of titt operation 
(Undtr 12 aoncht) 
12-18 aonehs 
Over 13 aonths 

Longtst ^cb tvar 

I yaar or last 
Ov«r 1 ytar 

• WmJcs worktd iMt yaar 

• Araa unasployaant rata 

< 

Tiaa tinea laac incarcaration. 
»;:avar lacarcaracad) ^ ^ 
12 taonnhs ago or lata 
Hora chaA<12 montha ago ^ 

Had any arraat laat yaar 

• Kusbar of arraata (avar) 

2var tiaa any dru? '(axcapc marijuana or alcohol) 



1*61 
-4.69 



10.53 
-2.60 



*3.23 

.20 

-8. 72* 

-26»42*»« 
-9*84" 

.32 

3.39 

6.77 

-3*63 



4.60 
-1.65 



6.94« 
8.10 

-.05 

1.7T 

-4.80 
-4.27 

.43 

-.06 

-2.92 



3*47. 



-11.59 
-U»04 

•32.51*» 

4e36 



2.71 

-4.03 
-18.71V 

-18.03*** 

-5*23 • 

.87 
.53 
1.10 
-5.13 



*6.93 
1.89 



-8. 94* 

-9»35 

.27 
.21 



-7.31 
3.97 

10.32* 

.14 

5.96 



-7,25 



n.a. 
•35.47 

n*a. 
-9.34* 



9.84 

15.64** 

20.91* 

-29.32*** 
-15.64* 

3.60** 

13.03 

-31. 58**- 

-12.91* 



n.a. 
n.a. 



-6.62 
-17.82 

-.10 

-4 21 

1.41 
2S.30* 

-3.36 

-1.68* 

15.59. 



VAJtlAILgS MftT qagp iU OUTCOME 
ANALYSIS aCGSUMSIONS 

^iiidanea f Inatltudon) 

Othat't Hona 
Slant 



27.85** 

16.53* 

14.32* 



27.14** 

19.27 
17.57 
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-6.24 
n.a, 
-.44 



TABte ».2- (CONT'D) 



. 8u«iintt Intwcvlw in S* ottLc* 


: i$7to 


4Va7 


T~^^3TX3 




.OS 


2,13 


X.36 ' 


8xp«,ct«<S w«9« p«r WMk ($100) 


*«s 


iSO. 


7X0. 7l** 


Prtssuncl to find job 




2.62 


-X3.44 


Uy^; in- public houiiu? 




.10 


-5.X8 ' 


Uv* with p*r«nt« ^ 




X2.4«*» 


-X8.25 


• Un^rh of intwr/i«w (ainutM) 


-f.OS"' - . 


-.07 


-.23 


Mspondtnt ccop«rativ« « ^ 


7.91 


S.22 


-8.70 



MOTES: Th« •ffcct of A chftn^t in a continuous v»ri«bX« Z. on th« ptobtbility of rtsponso is 0 •f(z6), 
whon 5 is ths cosfficisnt on Z. in •quAtion (XX)^(ths peobit woUl) sjid f(Z5) is it*nd«rd 
normsl dsnsir/ function^ .svaXuAtsd st ths point Z6, This si^rsssion al^o ssrvss, in ost 
cases, as a v»ty good approxiaacion to ths sf fact oil. a ehanga in a diserata (duany) variabXa 
on tha probability of rasponsa. Kancai this is tha nathod uiad to coaputa tha Marginal impacts 
prasantad hara. Tha dansity function f (Z6) is avaluatad usin9L tha saan vaXuas for aXX tha 
variabXas in Z. All of thasa partial ia^cts ara ajcpras'aad in taras of parcantaaa points 

(iOO*4 f(Z5))* r ? a- 

For continuous variabXaS (thoaa markad witK • in tha Xaftrhand aargin), a changa of ona unit 
is pradictad to laad to a chanqa in tha probaj>iXity of raapondin? aquaX to tha value given, 
ail oth.er factors being equaX. For discrete variabXas (thoaa not aarkad witS •) , there tnay 
ba two or more 909%iblm vaiuas. Race, for 'exasipXai^has thraa possibXa vaXuas .(bXadc, 
Hispanic, or white), whiXa '^liva with parents** has ooXy two poasibla vaXuas (yas or no). 
For variabXas with onXy two possibXa «/aXues» the value 9iv«n in tha table is tha difference 
in the probsbility of response for those who do and do not exhibit tha given trait. For 
variabXes with three or aora outcotaas. the value given is the aaouAt by which tha predicted 
probabiXity of response for individuals with the spacifiad characteristics exceeds the ex- 
pected response probability for those with tha characteristics givan in parentheses, 
a/ 

- Jersey City Is the excluded site. - ^ 

•Cstioate of coefficient corresponding to this variabXa is statisticalXy significant at the 
XO percent XeveX (two-taiXed test). ' 

•♦Sstiaata of coefficient corresponding to this variabXa is statisticalXy significant* at the 
5 percent XeveX (two-taiXed te«t)-. 

•••Estiaga^of coefficient corresponding to this variabXa is StatisticaXly significant at the 
I percent XeveX (t^-taiXed test). ^ 

• rndicatas- variabXe is coiyinuous. Ail other^ are discrete, 
n.a. ^ans not appXicabXe. 



Aiwpng^ ethnic groups, . tha^e ware substantial and significant differences 
in the probabilities of response ^ with whites being the least likely to 
respond, followed by Hispanics ^d then. blacks. Youth living with their, 
^parentis werl also muqh more li^aly to respond to the 9-, '18-, and 27-m6nth 
-inte rviews than those who did not. Also, thos e livi ng in institutio ns 
wore less, likely to ^respond than those living els.ewherfi, and renters 
tended to be somewhat less likely to respond than those living in their 
own hon»s# 

The' findings for length'^of longest jbb were perverse. Those who 

had, held a job. for up to one year were more likely to respond to the 9- • 

• • • 

and 18-WDnth interviews than those vAiq had , never had a job, but, were 
significantly less likely than nonworkers to respond to the 27-month 
interview. . v t ' ' 

A few other variables were foijnd to be statistically significant 
^ dete'^cminants for either the early qr the 27-month interviews— but not 
both — including whether lived in public housing, whether arrested, and 
experimental status. This flatter finding is the most significant for 
this, analysis. The results indicate that experimentals were signifi- 
cantly {S percentage points) more likely to respond to the 9- and 18- 
laonth interviews than controls. This factor suggests that we should 
be particularly concerned abdut potential nonresponse bias in results 
for the 10-. to l&-month period. 

Results^..for».the 36!nnonth sait5)le were quite different than for the 

'9-, 18-, and 27-month samples, due primarily to the small sample size 
fN«131) . The relationship between race and probability of response 
found for the earlier interview?; was also apparent ffor the 36-month intrr- 
views, but this was the only common finding. , Several variables had ' 



istitiitic^ly ^gn^ coeffipient^i^ in the response ecjui^tion, but in 

many cases the direction of. the estimated relationship was counterin- 

" ' ' ' ' - \ , " 7 ' ^ 

-tuit'ivf. Purthennori,. a X j:est of the hypothesis that all the coeffi- 
ci«nta were equal to zero could noi be rejected at the one 'percent level 
(although thii hypothesis was rejected afi" the five percent level) . Thus 
the, results for the 36-month sas^le should be viewed with considerable 
suspicion. ' " 



III. THE EFFECT, OF NONRESPONSE ON ESTIMATED PROGRAM IMPACTS 



With the estimates of the parameters of the • nonresponse model/ 
we can construct the estimate of that part of the disturbance term in 
equation (12) that is correlated with^-the regressors Z. As explained 
previously, this procedure yields a new variable, \, which can then be 
included as an additional regress6r in the estimation of equation (12) . 
Under the assumptions of the procedure, this regression produces 
asymp'^otically unbiased estimates of the effect of experimental status 
(and control variables) on the outcome vajc*iabie (Y) of interest, despite 
the--fac1;^jthat_only_data on responders is used in the regression. ^ - 
Comparisorii of these results with the estimates obtained with A excluded 
provides evidence of whether or not analysis of data on re'sponders 
leads to unbiased inferences about the intact of Supported Work.^ 



- As pointed out previously, the reliability of this evidence 
depends upon the validity of the assumptions involved in the model. 
Furthermore, although disqrepancies between the alternative estimates 
suggest that there is likely to be nonresponse bias, a correspondence 
of the two sets of estimates may indicate only that the model of non- 
response is not 7cod enough to ::ermit ietocticn bias. 



ALtiibu^ unadjusted eatijutti olf program effects are presented in the 



Min'^bOii^ of this reports we repeated the calculations on the saxqple 
analyzed here in order to ensure that any differences between the^ 
adjiuited and vmadjusted. estiM progran inqpact^ reisult from .the 

adjustxMnt alone rather than to differences in the saxqpl^s ised^-^ 

Altbo\igh >mahy different outcome variablel are examin 1 in the 
final reports on the. effects of Supported work, only a. subset of the 
more inqportaht outcomes has been.selected for examination here*. Thesa 

are hours worked/ earnings, whether participants were arrested/ and 

2/ \ 

whether drugs were used for each of the, four nine-month periods,— , 

Estimates of the inpact of Supported Work on each of these out- 
comes/ bpth with and without correction for possible nonresponse bias, 
are contained in Table B.3.. In general, the alternative sets of esti- 
mates are very similar. Estimates that w^re statistically insignificant 
prior to adjustment for potential bias remained insignificant, while 



—'^The methodology employed treats as nonresponders only those who 
did not submit to an interview. However, observations were also made 
unavailable for analysis when respondents failed to answer specific key 
questions. For a number of reasons, including the fact that .only a ^rnall. 
number of observations was involved, we ignored this type of iion response. 
Alio observations with insufficient dat^ on personal characteristics w'ere 
excluded from the anauLysis. These were often respondents who had received 
early versions of the enrollment interview. , f , 

•^'''it should be pointed out that each of these variables is either 
a binary variable (such" as whether arrested) or a limited depenjdlent vari- 
able (hours worked). Hence, ordinary least squares regression is not the 
most appropriate method of analysis. However, for cost reasons it is- the 
primary methodology used throughout the analysis of the effects of Supported 
Work. Since the purpose of this l^pendix is to determine whether the re- 
sults of these analyses suffer from nonresponse bias, we employ the same 
estimation techniques. It should also be noted that pon^arison of the 
least squares results to those obtained from more appropriate techniques 
such as probit and tobit showed very little difference. 
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' uNMiaiisTn) AND Aoausred jroR .HONi^ra^e bias 



Na«iri: iforked . p«r month' . 
Bttrnimjs por^ montii (dollars) 
FrotMUaility c< arrest <klOO) 



HcmtlisaOria 



Honths 19-27 



Hotitli&:28T3G 



Unad|tMifced:> Adjusted Unadjusted . Ad jue tod Umsdjuatcd Adjusted Unadj ug ted Mitistcd > 



/robabiiity of drug.use <xlO(/) 





85.36*M 


13.21** 


iS.88*»* 


6.61* 


8.77 


-18. U 


-7.58 


21/7. 69*»^ 


' 226. 54»** . 


28.19 


^8.36 


21.94 


31.32 


-166. /O" 


-124\85* 




.24 


2.24 


.45 


-3.41* 


-3.90 




-2.B2 


-1.86 


-1.45 


--•18 


,-.41 


.48 


.82 


-4.''>3 


-3.39 



n6t£} 'Itiese estlMtes ot progran in(M'ct differ^; somewhat fron those containod in the final reports on t[;he evcttuation of 

Suppotrted Work because sasiple sizes are snalJler here, tlie sample sizes result from ^imitinq the nunrrt^onse analysis ^ 
^ , to* those individuals for whom all necessary pre-enrollnent variables, are available. 

e 

Tlio significance levels indicated for experimental effects after adjustment for non response may not bo strictiy accurate 
because the estimated standard errors used for these significance tests # obtained from the regression program^ are biased 
if the covariance o defined in equation <14) is not equal to zero. Itowover, in practice, tJm true t ^Pt statistics are 
usually very close Co^the ones reported by the regression program. Iloiico, the significance levels givui liere arc indica- 
tive of the actual significance levels. 



^Statistically' significant at tl»e )10 percent level (two-tailed test). 
**Si-atistlcally significant at the 5 percent level (two-tailed test). 
***Stati8tically significant at the 1 percent level (two-taijed test). 



n.a. means' not a{)plicAble. 



those that wefe significant exhibited aljtost-no change in size. The two 
exceptions to this were for hours worked: during the 10- tq 18-inonth and 
the: 28- to 36-Hoonth periods* Pripr to adjustment for bias, the estimated 
Experimental effect for the earlier peiiod was 13.2 hours* per month. 
After adj\istment for potential bias, this coefficieht increased to 15.9, 
an increase of 20 percent. .This finding is consistent with the results 
from the probit models of nbnresponse in which we found that .statxis had 
a significant 'in5>act on response rates .i^ 

For the 28- to 36-morith period, the adjusted and unadjusted results 
differ more widely: the estimate of tKe earnings impact decreased by 
34 percent from $167 per month to $125 per month. Because the 28- to '36- . 
month sample aize is so' small (90 observations) , this .result is likely 
to be a statistical anomaly not worthy of much attention. 

In general, statistically significant differences did not change 
after correcting for nonresponse, nor did the general order of magnitudes 
of estimates of program impacts. Thus, these findings suggest that non- 
response bias does not seem to be a prevailing problem for the analysis. 



^An intuiti-re explanation for this finding for iouth hours., 
months 10 to 18, is as follows. The regression coefficient on X in the 
"adjusted" equation for you^h hours was positive and significant. From 
equation (16), we seefthat this coefficient is an estimate of O^^/ {0^^)1/2. 
Hence, the covariance of the disturbance terms in the hours and 
response equations is positive. This suggests that those with higher 
hours worRed are more likely to be responders, other things being equal, 
and those working less are likely to be nonresponders. From the non- 
response model results, we know that in the youth group, controls were 
significantly less likely to respond to the 9- and 18-month interviews 
than were experimentals. *Thus, the observations excluded from the analysis 
because of nonresponse were more likely to be nonworking controls. 
Inclusion of such observations would increase the estimated experimental- 
control difference. This is precisely what the methodology employed does. 
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at l4Mt.%ih«n th«.«ff«cts of status are modeled in the single way used 
here V . It is «ls6 inportsjit to determiner however, whether estimates * . 

' of Supjpofted Work's impact are biased ^en sucH- estimates are allowed ; 
to wjy With characteristics of the program. One finding that occiirs 
regularly is that program 'impacts differ by site. Hence, we also 
examined estimates' of program impact obtained from ^ a model that takes 
this into account for evidence of no^esponse bias.A^ 

The results contained in Tables B.4 to B.7 show little evidence 
of sxibatantial nonresponse bias for the ip- to 18-roonth and 19- to 27-month 
periods Estimates of program effect on hours and earnings for the 
various sites diange somewhat aft^r adjustxnent. However, most of these 
estimates are small' and statistically insignificant, both before and 

« after adjustment. Of, those that are significant, the largest change 
is for Hartford (months- 10-18^ where the estimated experimental effect 
increases from 14 to 18 hours per month (am increase of 33 percent) . 

We find no evidence of bias for the other outcome measures, 
however, for any time period. The sample sizes for the 28- to 36-month 
period are so small that meaningful inferences about program impact 
for the various sites cannot be drawn. Hence, the issue of bias for 
this period is moot. 



1/ 

Estxmates were also obtained for models in which estimates of 
program impact were allowed to vary with the length of site operation. 
Since.no evidence wi.s found to suggest ^at^this program characteristic 
had a systematic effect on program^ impact,, these results are' not 
presents here. - ,v 
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i UNAU;fUSTEi) ANalAUJI)Stkl) >t)R NONKKSWMSE filAS 

i youni sahhij: 



Site ^ 
Ailvnta. 
ll«rifor4 
Jeriey City 
New York 
PiilUUetplilM 



62. 30*** 

35»oe* • 



1*9 

Adjuttcd' 



DHTd 



iuttifi 



lO-U 

AiljutUJ 



H<mtlui 19-27 



84.93*** 
93.63*** 
.9fi.i7*** 
63»74*** 
36.16** 



JIO.37 
I3*7e* 
, 5.30 
22.83* 
13.20 



li.l8 
18.37** 
5.91 
24.17* 
12.69 



-45.82 
8.32 
5.06 
18.14 
7.98 



-3«.3i. 
10.05. 

^03 
19.82 

8.04 



-41.27 
-24.31 

n.a. 

9.12 



,2.5i 
-17.66 
n.a. 
9.74 



Male; Tliete ettiwiLet of progrMi iaptct differ Moaiewhtt fro« thuse contained in the final reports on the evaluation of Supported Voric 

hecauae aa«ple Kl^ea are SMller here. The a»»ple aixea reault froM Unit ins the nonreifponiie an^lyaia to thqae indlvidtiaia for wiib« 
Mil tieceaaary pre -ettroUttent Variables are available. • N . ' * 

the aignifica 4 levela indicated far experiMental effrtcta after adjuat«eiit for ooureaponae «ay not be atrictly accurate because the 
c'atiwited ut9 .irJ errora uaed for theae significance I. eats, obtained frotr the regreaaloti progran, are biaaed if tlie covariaiice U|2 
defined In ei|U4ll.<n (If*) ia not equal to zero. 'However, in^practice the true teat atatiatica^are uaually very 'close to the ones 
^reported by fhe i«;gre^/sioM program. Hcuce the significance levela^ given here are indicative of the actual algnif icsnce levela. 
. - • ) • • , , * ^ . ' . 

^SlatlsticaUy ai^niri.raiit at the 10 percent level (two-taileil'jLest)^. , 
^"^tatiatically aignili«*aiit at tlie S percent level (two-tailed teat). - ^ ' ^ 

<-^Statlstica|ly»sigiiilirttiit at the 1. percent level (two-tailed test). . " . 



u.u. Mu;aiis not applicable. 



UNAUiUSTU) AHP AaiUSTEO FOH NOMKESeOMSK BIAS. 
' YOUTH SAHfllE 





* 




%' 














NOAtllH 






10-18' 


HoutliK 19-27 * 


HuHtkit 28-36^ 




UoMiljuiteil 


Aajuiuu ' 


Unadjusteil 


, Adjuitea 


, Uoailiiikted 


AdJuatea 


Uoadjuaied 


AUjuatca ^ 


Site 
AiUnU 
tiJirifQra 

New York 
fliiljideliihia 


17B.71*** 
233.79*" 
251, 56*" 
195,90^»* 
75.78 


188.38"* 
248. 42*** 
254, 17*** 
201.27*** 

79.79 


-4.77 
39.79 
s .59 
59.79 
-11.50 


-3.78 
41.41 

- ;38 
60.26 
-U.68 


« 

-293.75 
51.20 
-10.37- 
32. 7J 

*- -28,79 * 


-236.69 
58.16 s 
1.59 / 
39.47 
29.02 


• 

s^.a. 
-222.20 
i -194. 41** 
n.4i. 
-66.07 * . 


-51.59 
-168. 52* 
II. «. 
-63. 



i?ai7">li7«Tc7t7i«^^ Pfogras ivfiact differ 80«iev«iat froM tlioae contaiued in the final reports on the evaluation of Suwwrted Work 
tecauMe aatfol^ aiiva ar«! aa^aer here. Tlie aaa^ile aixes reaulL frMtf liMiting thti noareaponae analyaia to tkoae iudividuaU io? 



ia«pli^ 

all neceaaary pte^enroUacnt v^^riablea are avaiJaUlc 



wboM 



^ntal effects after adjuat«eut for nonreaponae My not* be atrictly accurate because tlie 

d sundara^^rrora uaed for tUeae'^aignificauce testa, obtained fro« the regreasion prograai, are biaaed if the covariaiic* 0|2 
in enuatiim (14) ia notequal to zero. However, in practice the true teat statiatica are usually very cloae to the ones ' 
by the rtgreaaion pro|(raM. Hence the significance levels given here are indicative of the actual sitnific4nce levels. 



The significance levels. Andicated for experi 
ettiauited 
defined 
reported 



^Statistically aignifiunt at the 10 percent leve^ (two-tailed tesi). 
^Statiatically aignifiunt at the S percent level (two-tailed teat). 
^-^'^Statislically aigniCii4nt at the I percent level *(two-tai led teat). 

n.a. Means not applieablu. ^ 



l>KOKABli.iTY OK BEING AKh^STED Vim), 
KECKES^UOM ESTIMATED EXPERIHEHTAL-COHTROL UlfPERENTIALS. - - • ^ 

UNADJUSTED AND ADJUSTED fOK NONKESI'CNSE BIAS 



YOUrni -SaHFLE 





Hofitlis 




Mouths 


10-18 


MonLlis 


19-27 




Mouths 


28-36 


Unadjujitetl 


Atljustetl 


Unadjusted 


• Adjusted* 


Unadjusted 


Adjusted 


9 UoiidJusCed 


-Adjusted 


Site ' 








' ' i 












All aula 


8.67 


7.58 


3.06 


1.26"* 


5.76 


4, 


05 


n.a. 


n.d. 


HttrtfurtI 


1.66 


.01 


1.95 


- .99 


-6.36 


-6, 


76 


.91 


-la.73 


Jersey Cily 


-5.88 


-6.18 * 


3.71 


1.32 


-2.52 


-3, 


21 


1.26' 


-1.72 


New York 


4.84 


4.23 


6.18 


5.32 


26.68 


26. 


29 


n.a. 


n.a. 




2.16 


1.71 


-11.86 


-li\53 


-2.95 


-2. 


96 


* 2.55 

e 


2.27 



NottT^ Ttiese estiwates of program iapact differ somewhat fro« those contained in the final reports on tbe evaluation of Supported ^*ork 

because sa«ple si^e:i are s«aUer here. The sanple sizes result fron liwiting the nonresponse aualysib to |.hose individuals for whoa 
all necessary pre-cnrollMent variables ate available. ' - 

The significance te^/els indicated for experi»ental effects after adjustseut for nonresponse aay not be strictly accurate because the 
estiwated standard itrrors used for these significance tests, obtained frca tlfe regression progra«, are hissed if the covariance Ox'z 
defined in equation (14) is not equal to zero. However, in practice the true test statistics are usually very close to the ones 
reported by the regression program. Hence the significance levels given heic are indicative of the actMal significance levels. 



^'Statistically signif i(';iiit at the lO percent level (two-tailed test), 
^'^^t'dtist ical ly significant at the 5 percent level (two-tailed teut). 
«*«Slati:;t Ically signifitaut at <the I percent level (two-tailed test). 



n.o. lueans not applicable 



PROBABam W*USINU DRUGS, * . . . ' . ^- 

KEGR^SION KSTIHATEI) EXi'ERlHWrrAr.-COMTKOt OIKFKRENTUIii, ' ' ^ 

UMAIUUSTW) AHD AIWIISTKO KOK MOHRKSKOKSE BIAS . - . 

YOUTH SAftt'Iiv i 



Mooths 1-9 



HontbslOria 



UiiadiustgJ AJjuateU lloaUjuKteU Ad justed Unadjusted 



Kontba 19 *27> 

AdjuitleH 



HontUv 2&-36 

Adjusted . 



U nadjuste d 



Site 
AtUuta 
U;«rtford 
Jersey City 
Hew York 
Pbiladelpbi4 



-5.25 
-1.13 
-5.17 
2.93 
-6.27 



-♦.78 
- .42 
-5.05 
3.19 
-6.07 



1.9a 

1.94 
-8.78* 
-4.49 
20.49** 



1.83 

1.74 
-8.82* 
-4.56 
20.50**' 



.30 
2.40 
-6.50 
- .28 
11.39 



1.00 
2.56 
-6.23 
- .13 
11.40 



n.a.. 
-24.83 
-4.r9 

n.<ft. 

1.26 



n.d. 
-24.07 
-1.07 
n.a. 
1.27 



Kote* TUese estinates of prograa iapact differ somewhat froa those contained in the final! reports on the evaluation of Supported Work 

Uec^iuse usm^rtt si^es are saaller here. The sa»ple sizes result froaT liait ig the nonresponse analysis to those iudiviUuals for whom 
all iiecessdry pre-^enrollMent variables are available. 

Tlie sigttificauar levels indicated for eiperiwental effects after adjustment for ooncespouse My not be strictly accur^il'fe because the 
estimated stand.ir»l arrors used for these significance tests, obtained fro« the regression prcgraa, are biased If the covariauce 0,2 • 
defined in equali.*ii (14) is not equal to zero. However, in practice the true test statistics arc usually very close to the ones 
reported by the regression program. Hence the significance levels «give« here are indicative of tliL- actual significance levels. 

•*. • • 
'^Statlsti^aUy siguiiiraut at the 10 percent level (two-tailed test). ^ • 

^-^.Statistically significant at the 5 percent level (two-tailed test). " ^ 

***Stalis^i4rally signili.ant at the *l percent»level (twd-tailed test). ' ' , 

n.a. «ti.uis not appi ic.tble. ' 



'IV.' CXDNCLUSiON' 



In this Appendix; "we have investigated whether nonresponse to , 
follow-tjq? interviews led to bjjased estir:ates of the inqpact of Supported 
Work. Using detribgraphic amd background data obtained from^a baseline 
interview administered to virtuJdly' all eligible applicants to the pro- 
^ram, we estimated ^ n>odel to pr^ict the probability of response for 
each individual. We then used the parameters of Jihis model to construct 
a new variflJale that, when included in the regression equation of interest 
accounts for^the fact that data only on the responders are available for 
analysis, under reasonadale assun?>tions, estimates of Supported Work's 
intact obtained from* the standard regression model with this additional 
variable included will be free (asymptotically) of any nonresponse-.bi^ as 
that may have been present in the unaltered regression models 



To determine Supported Work's impact on a select set of outcomes , 
both the standard regression equation smd the augmented equation were " 
estimated fo^ each outcome. Comparing the alternative sets of estimates, 
we found little evidence of nonTasponse bias. When simple models provid- 
ing an overall estimate of Supported Work's impact were used, only 
estintetes for one outcome {hours worjced) showed any evidence of bias, 
apd this evidence .did. not suggest any change in conclusions about the 

' / ' - ' • • * 

existehce or general' magnitude prograin effects. When a more flexible 
model was uited, wKich allowed estimates of progrsun impact to vary by site 
only little Indication of potei>tial bias observed.^ Thus, » we are led 
tauQonclude chat nonresponse bias is not a major problem, but the possi- 
bility- of some bias should be acknowledged. / 

216 . • 



^ — ^ ftithoughTthe~<:onclusions above, are cleatrly indicated from the 

reisvilts obtained,, they are valid only if the asstunptions on which the 
methodology is based hold* The key ^ssvunptions of this methodology, 
developed by Heckman (1^76), are: 

# That the disturb' ice terms in the regiassion arid response 
equations are distributed as bivariate normals^ 

• That a reliable model of the response equation is speci- f 
fied and estimated- 

A method for testing the normality eissiamption^ is not readily available, 
since estimates of the residuals in the response equation cannot be 
obtained. However, if we can do a good job of predicting response, 
then we have more confidence in our conclusions about whether response 
bias is a problem.- Clearly, if we add a variable which is just random 
noise to the model, we would expect Dittle change in the original 
coefficients, including the one ol status. 

Another aspect of doing a "good" job of predicting the proba- 
bility ot response is to identify and include vauriables that affect the 
response decision but do not affect the outcome of interest. The 
presence of such variables will lessen the likelihood that multicolli- 
nearity between the constructed variadDle (A) and the standard regressors 
(including experimental' statiis) wild confound the results. 

Judging f rojn X tests for the sets of coefficients and'^standard 
"t tests" for individual coefficients, we were able to satisfy both of 
thesfe criteria. Furthermore, in every case, at least one of the variables 
that were included in the response equation but not in the outcome equation 
was found to be a statistically significant determinant of response. Thus, 

0 - z-]?^^ 



we have reason to believe that the model does yield reasonable predictions 
of the probability of response and does not introduce a high degree of T 
cQllinearity into the regression model. Without actual data for the 
missing observations # we cauinot be certadn of the accuracy of our claim 
that nonresponse bias is minimal. However, our results do not appeeor to 
suffer from problems that we know could lead to erroneous concltisions 
about the presence of nonresponse bias. 
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-APPENDIX C 



THE EFFECTS OF LENGTH OF TIME SPENT IN SUPPORTED WORK 
'on PROGRAM IMPACTS 



by Randy Brown 




KERIC 
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A key difference ainon^ Supported Work participants that could have 
a major intact 'on the effectiveness of the program is the length of time 
spent in Supported Work. Since individuals 'Who dropped out of Supported 
Work shortly after entering might not receive the beneficial effects 
hypothesized to accrue to participemts, analysis was \andertaken of the 
effect of length of stay (LOS) in Supported Work on estimates of program 
impact . 

In order to allow the estimate of experimental^ in5)act to vary 

with length of time spent in the program, an. iiituitive approach would 

be to regress outcomes of interest, such as, earnings, hours worked, number 

of arrests and drug usage, on demographic characteristics of sample members 

/\ 

and on LOS. The experimental impact then could be measured as OLOS. 
where a is the regression estimate of the coefficient on LOS* 

Unforttinately, this intuitive approach to the problem may lead 
to erroneous conclusions. If individuals leaving the program early also ^ 
tend to be the individuals with the poorest post -prog ram performance, con- 
trolling for measured differences in personal characteristics, then the 
estimated coefficient on LOS will pick up not only the effects of Supported 
Work tenure on post-progr3an outcomes, but also the effects of any unmeasured 
characteristics which affect both LOS and performance. For example, if 
the more motivated individuals tend to stay longer in Supported Work,^ 
and if they also tend to have higher post-prog):am earnings, regression 
estimates will indicate a significant, positive impact (aj) of LOS on 
earnings. This result will occur even if LOS, per se, has no effect 
whatsoever on post-program outcomes. 

Statistically, the problem lies in the fact that LOS represents 

"1 26S 



a behavioral decision by the participant, much like labor supply,, and 
as such may be corr;eXated with the regression error pterm/ which includes 
the effects of all unmeasured veuriables (such as motivation) on the de- 
pendent variable. In this case, least squares regression produces biased 
coefficient estimates. This problem is referred to in the econometrics 
literature as "selectivity bias.'" 

Since LOS is an endogenous regressor, an instrumental variable 
estimator is required to produce estimates which are asymptotically un- 
biased. 'A model was developed to explain LOS for experimentals, as a 
function of their personal characteristics. This model was then estimated 
and the results were used to obtain the predicted values for LOS. The 
outcome regressions included the vector of predicted values of LOS as the 
instmment for LOS for experimentals and^'zerb^ values for\ controls. 

The model used to predict lios for experimentals was a Tobit model, 
since LOS is a bounded variable. Furthermore, since it was felt that 
Supported^ork would have no impact on outcomes for those remaining in the 
program only a short time, all participants remaining in the program -for 
less than 2 .months were considered to have an effective LOS of zero. 

The results of the estimation of the LOS model are presented in 

Table C.l. They suggest that the Philadelphia site has a much lower average 

length of stay than tjie other sites, after controlling for participant 

characteristics. Females, youth with 10 or more years of schooling, youth 

raised by two parents, and those who had held some job or training prior 

to enrolling in Supported Work were also likely to remain in the program 
I 

longer.— 



•^^These results are very similar to the ordinary least squares e^i- 
mates of. weeks worked in Supported Work jobs, presented in Table A. 6. 
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SSTIMXTEO TOBIT COliTIciKiW^ ANolpARTIAL IMPACTS 
. (OBdittd 'varUbXiii In-pi'rin^^ 



Variable. 



Atlanfa 

Hartfort 

( JarsaV; City) 

Nftlt York . . ' ! 

Phiiaclalphia * .| 

(Enrolled Before 'July 1976) | 
Snroiled Juiy-Oecember 1976 i 
Bnrolied 1977 ' 1 

(Age < 17) \ 
Age la 

19 ^ /: 

' Agei ^ 20 I 

Malt 
(Female) 

White 
Hispanic 

{3Uck and Other) 

•(< 10 Years of School) 
10 Years of School 
> 10 Years of School 

< 1 Year Since School 
1-2 Years Since School 
(> 2 Years Since School) 

Expelled rroi^ School or Left 
p3e;:ause of Troufc^le With Law 
I Left School for d&?r Reasons) 

Lives with Parents »: 
(Does not Live with Parents) 

Haised by Two parents 

(}{ot Raised by Two Parervts) 

Married and/or Has Dependents 
(Not Married and 5Jo Deoe^dcr ts) 

Receiving Welfare or Food 3 tamos 
(Not Receiving Welfare) 

(No previous^egular Job) 

Longest Regular Job Lasted < 6 Months 

Longest Regular Job Lasted >^ 6 Months 

(No Job Training in Past Year) 
Some Job Training in past Year 

^.rcves:— ^JLsedAny Drugs) 
•Ji-ed vnly Mariii2ana---^__^_j_^ 
' osed Drugs Other than Marijua 

(Never Arrested) 
One or More Arrests 

(Not on parole or Probation) 
On Parole or probation 

Constant 



Eai:i»ate<l t 
Coefficient ^ 


Estimated . 
Effect on LOS- 


-.92 


-.71 


-1»43 


-1.11 


.11 


^ ,08 


-6. re • 


-4.30 


-.65 , 


p 

-.51 


-l.i3 


-.88 * 


-1.16 


-.90 


-.82 


-.64 


-.94 


-.74 


-1.69. 


-1.31 


. -.64 • 


-.50 


.72 


,'56 



1.65 
1.38 

.15 
.61 



-.99 



.20 



irt 



-1.49 



.81 



1.79 
1.31 

1.87 

.39 
.93 

-.73 

.51 
6.71 



1.28 
'1.08 

.12 
.48 



.77 



.15 



:83 



•1.16 



.63 



1.39 
1.02 

1.45 

.69 
.72 

^-!.81 

.40 
5.22 



t-ratio 




*-.74 • 
-1^57 




.09 
-3.93 


'i 


-,74 
-1.19 


J 


-l!43 
-.89 
-.31 


' 'J 


-1.76 




-.47 
.81 


• 


2.28 
1.56 ' 


V 


.19 
.78 


' 1 


-1.37 




.28 




1.68 




-1.45 




' 1.04 


*" -, 


2.39 
1.42 




2.18 




:.i4 

;.09 


'I 


-1.04 


f \ 


.60 


* ^ 


4.06 





-^T.*ie effect of the ith variable on e^cpectec LOS is computed as a FfxS/ff) wnere 3 is 
-rcftfficient ->n -.he t:h ririable.. ^ ind ? *.r^ -.he ^sti^ated xrefficiar.r -^rr^r 
and itandard^errorJ rescect^.vely, and Ftx§/a) is the normal distribution function, evaiuat^ed at the 
aeln value of the variables. 
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.Wcr then us^ these estimates' to construct/ the instrument for LOS ^ 
and compute an instrxamental variable' estimator for the parameters on the * 
outcome equation* Table CI 2 contains the instrumental vatriable esti- ' 
, mates of the effect of length of stay in Supported Work on hours worked 
and earnings in the 16- to IS-month period', and on hours worked, .earnings, 

whether arrets ted and whether used drugs for the ].9- to 27-month period* 

'J 

Also presented for comparison are ordinaj^r least sqj^ares regression esti- 
mates of the effect of LOS, which as noted above, axe likely to suffer 
from selectivity bias. 

The results for the ea^rly period tend to confirm this sqspicion. 
The least squares estimates of a (in the columii' headed CLS) suggest tha€ 
LOS in Supported Work had a substantial and statistically significant 
impact onf hours and earnings' of participants. The coefficients in5>ly ' 
that for each additional month spen£ in Supported Work, youth would work 
(on average) 2 additional hours per month and earn an additional 7 
dollars: Thus, these estimates suggest that yon.th remaining in Supported 
Work for 6 months (roughly, the average LOS for youth) worked 12.7 more 
hours and earned 42 more dollars per month in the 16- to 18-roonth ^eriod 

than cbnparable control group members, 

> 

The instirumental variable estimates which account for selectivity 
bias are contained in the coluidns headed "IV." These estimates suggest 
that there is virtually no effect of LOS on outcomes in this 16- to 18-month 
period. Implicitly, this finding suggests, that the estimated large Effects 
effects of LOS on outcomes is due solely to differences in unobserved char- 
acteristics, such as motivation. 

— — / ■. .. \' : 

For the/ 19- to •27-month period, even the least squares estimates 
indicat/a that there is no effect of Supported Work for ^y length of 



\ 
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" TA3LE. C. 2 ^ 

ESTIMATES OP TitE EFFECTS' OF AN ADDlTl'ONAL MONTH 
IN SUPPORTED WORK-, • 
(t-stati'ltics- in par«rtthe««s) 







Months 


16rl8- 


Months 


19-27 




Outcbme 
Mtasxire 


OLS^^ 




- ' OLS^ • ^ 




< 




2.U*** 

(3.7)- 


-.06 
(-.08) 


(■V.15')a ' 


.-.63 
' .(- .62)' 


f 


Average earnings/ 
month 


- 7.01*** 
(3.3) 


.03 

(,01) ; 


-1.92 

..(-.59) 


-1.97 
.(-.46) 


} ; 


PtdbabUity of 
' arrest 


n.a. 


n.a. 


-.-0052 
j-lrl) 


-.0050 
(-1.0) 


! Probability used 
' drugs 

*^ 


• 

n.a. 


.n.a. 


. -.0035 
(-1.4) 


-.0015 
. (-.35) 



Number in San^le 



856 



413 



NOTE:\,- These sample si2es and thus experimental-control differences differ 
' Slightly from trhose in the text since only observatiicns .with data 
on all df the dependent variables^ are used. 

— OLS' refers to estimates obtaine'd by ordinary least squares 
regression* 

— ^ IV refers to estimates obtained by the instrumental--vaciahi^ — 



method. 



f**Statistically significant at the .01 level, two taUed tesr. ^ 



n.a.* means not applic2ible< 
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^ CHAPTER I 

• THE, SUPPORTED WORK DEMONSTRATION AND ITS EVALUATION' 

* ' * • 

The national Supj>orted" Wbrk demonstration , conducted in 15 sites 
ft * 

across the country, is a special *Work experience program designed"^ help 
groups with well-established employment difficulties to get and keep a 
regular job. Other important objectives of Supported Wbrk include 
reductions in -velf are dependence, drug use, 'and criminal activity* The 
four' target groups that provide the focus for the demonstration are (1) 
women who have beisn 'receiving welfare payments uiider the Aid to Families 
with Dependent Children (APDC) program for at least three years; (2) ex- ' 
addicts who have receiitly been in drug treatment programs; (3)^ ex- 
offenders who have recently been released from prison or jail; and (4) * 
young school dropouts, m«Jiy of* whom have records of delinquency « 

In o|:der to assess the effectiveness of Supported Worky a' major 
evaluation component has been biiilt^ into the demonstration. The effects 
of the Supported Work experience on th^T^specific target ffbups* are ^e- 

ported on elsewhere. This report assesses the overall effectiveness of 

<. ^ . ^ 

Supported Vtork within the arialytic framework of benefit-cost analysis. 
♦ <r 

A. THE DEMONSTRATION ' 1 . * ^ * " 

SUStt>orted Wo;:k is specifically designed to be a temporcury program. 
It provides individuals with eit5)loyment for a limited time, after which 
they miyst leave, whether or not they have found jobs elsewhere. Support 
is provided tj^ough work assigniofients in crews, of peers, and also through 
close supervision by technically qualified p^ple who understand the work'' 



histories and personal backgrounds o£ their crew inembefs* Graduedly in-* 

• ' • •» 

creasing standards o^ attendance and performance are, enforced as the . 

' • . "\ ' ■ . ^ " 

program *proce'eds, until .they Vesembla, those of. regular jobs. While in 



the program particiipants earn relatively low wages # nut eure given oppor- 
tunitias to increase their ea':mings..throu^ bonuses and j^romotions r6r 

good performance and attendance. , ^ . 

* " \ * • • *' 

• The work done by participants, most of it. relatively unskilled, 

is- Varied* It includes clerical assignfRents, hoxising rehabilitation, ^ 

btoil'ding maintenance, day care, euid grounds maintenance, and is concen- 

trated in the service and cdnstruction sectors. Goods and services -are 

«^ ' > 

provided for a variety of customers, many of them in the public and ' 

c '. c * ' * " * * 

private nonprofit sectors. In most of^ »the projects participants work 

under the. close^ supervision of Supj^rted Wbrk program staff; some, ' . 

/ ■* • . • * 

however, are outside placements in which the' dfiiV-to-'Slay supervision is 

provided by the host agency.^ , . 

The Supported Work concept was first iiplemented by the vera 



Institute of Justice, which staxted the wildcat program in New York in/' 

1972. .The primary tcur^et groups in Wildcat: were * ex-addicts and ex- * 

offenders and,' by* the middle df 1976, more than 4,600 had been enpldyed ' 

in the prograjni* The early experience with Wildcat led ^)[ectly to the 
•» • ^ ■ • 

<j * t 
national den»nstfatdon ^f Supported Work, designed to test the concept , 

on a larger scal^, and with two additional target groups — AFDC recipients ^ 
*. ' ■ ' ^ * • • " * 

N ' ' ' ' ' % 

and youth, ' • / ' 

. The ^demonstration is funded in part by gratnts.from the Ford 
Foundation and a cQnsortium of federal agencies led, by the Departmenjb of 
Laix)r, and in. part' by 'locally raised ;fxinds. .These .latter funds conie from 



government, sotirces (inpst often CETA priojae sponsors and welfaore diversion 
peiyinents) , and from revenues generatecfby the sale of program output. 



RECENT EMPLOYMENT AND TRAINING POLICY, AN;D THE DEVELOPMENT OF * 

. .SUPPORTED WORK ^ ' ' . * 

Two foajor developments in en^loyment and training policy during 

the last .^20 years have influenced the design of both the Supported Work 

program and its benefit-cost evaluation: (1) th? increased e^hasis 'bn 

» • .. ' 

targeting programs 6n the "disadvantaged" — persofts who face difficult 

beurrier? to eii5>loyment in the* regular labor msurketr-and (2) the 'growing 

reliahce ^n work ex5«3.ence as an en^loyability deveiopmenj; mechaniffii. 



.Both of these developinenivs -dre reflected in'^Suppo3?ted Work, and they 
provi 
'the )e 



provide a useful framework for understanding the program cbn^ept and 



5ved.uation# • 



•1. Targetinq^Progrijms for 'the' Disadvantaged ' ^ 

Direcjt government intervenrion in labor mark'ets -after "World 
yi^fll first- took the fori of assistance to 4epressed areas of the country 
rargely in r&agonse to "the steady ^ decline of the dominant industries in 
these areaa.' The\Area jiedeveldpment Act and thfe Public -Works Acceleration 



ssed in* the 



^Act^ both passed ih*the eaxiy sixties, addressed the enployrnent problems 
of .particuiw areas rather than^ particular groups in the population. - A 
change in policy direction crme in 1962^'with .the passage, Oo. the Manpower* 
Develojpment* cind Training Act (MbTA)i. Initially,, MDTA programs' en^hMsized 

' ^ See Mcinpowei; ^Demonstration Research Corpora t%5n (MDRC, 1978) for 
ai^detailed description *of^ the operatipn of^toe demonstration^ 



the. training and retraining of workers- whose skills were becoming obsolete 
"Because" o i"l^ecIuxoIogicaI and economic changes! 

^ — ^-^.J^ the mid-sixties lAe focus of the nation' s ^training and employ- 
ment p^icy again 'shifted, this time from workers witfi' obsolete skills 

* 

to individucd.s "who had little or- no job skills. With the passage of the 
Economic Opportunity Act in 1964 , program approaches wete Ijroadened to 

include the use of work experience, placement assj .stanc e> and other 

activities in addition to skills tredning, in order to address the 
eniployment problems of persons with few skills and liinited prospects 
for labor market success. During the same period, MDTA also shifted its 
enrohasis fro^retremiing to 'initial skill development and remedial educa- 
tion tor persons with few labor market skills- By the late. sixties, the. 
nation's enployment and t^^ning policy had been firmly committed to" 
targ.eting programs on the disadveuitaged- ' * . 

' Con^^ary to some predictions, the transformation in 1973 of.. 
eii5)loyment and training programs from the existing categorical, . national 

programs to a decentralized, decategorized set of programs under the 
ft 

Conqprehensive Employment and Training Act (CETA) did little to change 

« 

*this target enphasis. Fed.ercd. pJagram regulations and local s\:^port for 
targeted programs helped to maintain the emphasis on serving the.dis-. 
advantaged A Only in a few specific cases — such as the ^ countercyclical 

1/ * »• . - . 

While, the emphasis on serving the disadvantaged is apparent .in 

the legislation, the effectiveness of local programs in actually achiev- 

- ing this legisla-^ive intent has been the subject of considerable debate. 

Charges of "creaming"--i.e., enrolling persons with few labor market 

problems — have 'been leveled" at CETA for years, and program data suggest 

a mixed recprd in providing services to those who need them most. 

National employment and training policy's commitment to the disadvantaged 

. V ■ 242 ' ^'S6' * . 




publicrrseihrix^-eit^pioyxiiei^^ VI— has this legislative 

and polidy^^^ei^ been siispended* „ 

^ . , ^- - .-^Z' • 

Supported Work clearly' embodies this^emphasis on the disadvantaged 

in its four target groups. Indeed, the Supported Work demonstration has 

served a more disadvantaged population, judging from the demographic 

characteristics and labor market h istprlfts r>f -it-y p^Ti'icii:^ntBT--^^n 

programs funded under CETA~iAose eligibility criteria are less re- 



strictivis than those of St^ported 9fc>rk. AFDC recipients and youth are 
aisd^ served by a variety of CETO programs, and AFDC recipients by the 
Work Incentive Trauning Program (WIN) as well. The two other Supported 
Work t^^t groups — ex-offenders and ex-addicts — .are not served inl.arge 
numbers under CETA, but are generally acknowledged to face some of the 
most severe -ledbor market probleirs of any population groves. 

This esphasis on the severely disadvantaged has influenced the 
objectivesr of- Supported Work and lifence the design of the evaluation* In 

r \ 

addition to its central Objective of inproving the enployment prospects 
of its participants after they leave the program. Supported Work, as we 
have seen, seeks to reduce welfeore dependence, crimineLL activity, and P 
drug use, and po raise the income of participants. Given these . additidnad. 
objectives, the evcd.uation must also measure the benefits of reduced 
welfaure dependence, cri mined, activity, and drug use and assess the 
distributional effects of Si:tpported Work (i.e., assess the benefits and 
costs to the participamts themselves to determine whether they are made 



was clearly demonstrated througli this history: throughout the ,1970s 
, ^ program operators and prime sponsors have been under pressure tcKimprove 
the- targeting of their services. \ 

o " • - 

r ERIC 
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b€$^errpf^f-}r^:^'rhis-evaluat^ differs from benefit-cost analyses y 
of many eaurlier employment and traindLng programs in which the i|jc;?^se 
in post-program earnings was typicadly the only benefit ,,measiired and 
which distributional effects were ignored.^ (A reviev> of benefit-cost 
analyses, of other en5)loyroent and train'ing programs 'Us -ddntained in 
Chapter VIII.) ^ [ \^ 



The Role of Work Experience • * 

Although its in^ortance has risen more slowly than the en^hasis, 
on the disadvantaged,, the es^^hasis on work experience as an eii^loyability 
development strategy also began with the Emploimient Opportunity Act. 
Advanced as a mechcmism^ for providing youth with initial labor mcirket 
e^erience, work e:^erience was initially implemented only in a £ew . 
categorical programs such as Neighborhood Youth Corps # the New Career/ 
Public Service Careers Frogreun, 2Uid the Concentrated Employment Program. 

In the ^arly i970s,.the policy of providing subsidized jobs 

- ? 

received new support as a strategy for ^ reducing countercyclical unen^loy- 
ment ^ in contrast with, the eaurlier extphasis on structural unen^loyment) . - 
The Emergency Enployment Act,' for instance, which authorized the largest 
publi^ einployment program since the depression, embodied this^ concept. 
Recently, >^the funding for the .countercyclical; public service en^loyment 
has been substantially reduced. The structural coir5)onent of public 
service enployment, however, has been retcdned in Title IID of CETA. 
Thus, work experience continues- to be considered am importsuit weapon 

• ■ ■ I 

in the attack on structural unemployments 

The- evolution of United States pot±6y was not the only influence 

- * * - 

on the design of Supported Work; it also has roots irt Western Europeain 
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eiiperience.^ Dutchf Swekish, and British programs-^-slich as the Social 
Eni?loyB»nt Program/ Indus and Sheltered Em^loyinent — 

provide goverximent subsidized ezsploynent for persons with labor maurket 
probl^ns* The-^eligibility requirements for these ^progfams are quite 
\brbad. \ln addition to the mentally retarded^ the eligible indlude 
••older jworkersr young peopl/s in trouble ^ fotrmer prisoners r eQ^coholicsr 
and ^yexi * querulous persons, ..cross-grained fellows, .intiriguers'" (£<&uben3, 
1970) • Typical of thu progprans are. the Swedish "sheltered .workshopsc" 
which have Been described as "a working enviroiunent without conpetition 
from other iaboiif that . of f ers a f orm of enployment that^^n strain and 
teapo is adapted to the handicapped persons' capabiliries" (OEDC> 1963> 

p. 21) . • * . • \ 

• ■ " - ■ , ■ • " \ 

The demonstration f thus, exhibits both similarities with emd \ 

■ ~ ' ■ ■ \ 

differences irom bbth previous United States and European experience. 

i 

Its es^hasis on tremsitioneuL jobs msike^s the demonstration ^more similgtr 

to other U.S. work experience programs than to Western Europecin programs, 

- . ^ . ^ ^ 2/ 

whidh provide not only ten^H^reury but also permanent opportunities In 



\ 



\ 



its strategy of carefully structxiring the work experience, however, 
Si^ported Work more closely resembles the ^European programs. In contrast 
to most CETA job creafion programs, in which the participant is. placed " V 



' V: 



-^For a con5)rehensive discussion of the Western European job 
creation programs fo r the ha rd-tb~engloy, see Reubens^jH970) , particularly 
dhapte«u3fX. For a more detailed description, as well as^a presentatioa~bf 
the results of a benefit-cost anatLysis, of* one such program in Holland, 
iee iiAv^nah (1978) . * ' 

2/ • ^ ' ^ 

TT An 'exception to the general en4)hasis on transitional programs • 

,ih the U.S. is the set. of sheltered workshop programs, such as Goodwill 

iiij^ustrles,, that ^rpvrcte enployment. for disabled and hemdicapped workers. 

aaS^yer^ -t^ <iperated outside the formal govem- 



meht -enpioyTOnt- and traiiiihg system; \ 
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with an outside organizatiotrrSupported Work takes a more intensive ' 

. > . ' ' . J- 

approach to work/esqperielnce that utilizes close program supervision, 

graduated stress,, amd peer^ group support. t-; In implementing this approach, 

z ' » ' \ , * ' * 

Supported Work often creates jobs^ with supervision, equipment, . and 
mater.^^1lSf amd ^1 aspects of project operations under the direct control ' 

-:V . • . V '-. • ■ :■ ■ ■ - / - 

of program operators.— Supported^ Work jobs represent a much broader set 
of", activities pciaxi GETA jobS; ^notal ly including more construction, 
manufacturing auid revenue-prbducing projects. In this regard Sunported 
Work is more similcir to some, of its Western Eiiropean counterparts. Foi? .x, 

example , the Dutch Social Eirploym^nt. Program, has a variety of activitiesv 

• ^ . • * ^ :' " 

including revenue-producing industrial centers in vaurious mcuiufacturing 



activities (Haveman*, 1978) . • ' > ^ 

This emphasis on carefully structtired work experience, especially 

V 

the use of direct Supervision .by Supported Work program staff, not only 
. distinguishes it from earlier ^>rograms and many current CETA programs, 
-butHL-t--also--impMes*that^the-benef it-cost anal^^ -careful 



account of the inputs and outputs of the jobs created to provide work - 
ei^rience for participants. Such direct job responsibility raises tl^e . 
cost of Supported Work since the projects -require mal^rials, *»quipment, 
siapervision,, amd^ management for their operations. * At the -same time, the 

^. — — . ' ■ \ .' ■ 



jj^ It is int eresting in this regard that Supported Work places 



restrictions on the use of , supportive services-as supplements to^*jthe_ 
, v?ork experience, limiting them to no more than 25 percent of enrollment 
' time*, ■ , ' ' - w ' ' * ' 

^ In Recent years- more interest has been shown- in tlje "project" 
.^^cdncept, in. which several CETA participants work t;6gether on ar crew 
, ooirig similar work. However, this, approach is still used relatively 
infreqpien^ in CETA. ^ • ^ ' • , ' 



V - \ work, experience projects produce output while participamts are enrolled, 

k::- •■• ^ .' - " ■ ■ - • - ' ■ 

V'^ . . arid the value of this output must be measured and included as a .potentially 
i-; '\ . impoirtismt benefi't. Evaluations, of. earlier training programs, where the 

only substantial benefit (from increased eii5>loyad3ility) accrued after . 
V. * . ; the progrcjn/ did not face> this mea surement-problem^^- ~ 



" - , -G./z THE 'BENEFITdZOST: ERAMEWOiOC \ ^ . "7 
,,5. . ' \ The. benefit-cost analysis reported here 'values the benefits 
attributable. to; the prograun, both during and after program pstrticipat ion, 

\ ^ J ■/ ^ . ^ ■ ^ ... ; ^ , ^ 

and compares the program's benefits with its costs,* This comparison in-' 
voives a largp and sometimes conqplex set -of calculations. The- relative 
* .vaiiies of a wide range of ciiJtcomes — involving emplQyment rates, welfare 
dependence, criminal afctivity, and drug use-^must be coit^ared to the cost 
* of a wide* ravage of resources used^in of)erat:ing the. 'program. Such a 

_ comparison requires not only th^t the various comEK)nent outcomes and 
' * costs Ije identified -and. me'asured, but also that they be given an 

appropriate dollar value so that* all the diverse components can^ be 



^co^^ared. ^ 

The procediire used tq, cocpcure "totad. benefits and costs involves 
cadculating the prograun* s "net present value"~that is, the difference 
bietween benefits and costs where all dollar values^ have been ad j listed 
for inflation and converted to. present values •i'^ All components in this 
calculation are expressed as benefits or. costs per participant. The 



-^Conversion to present values here means- that all benefits and 
.costs for all periods after/the first have been discounted to the middle 
of the first 9~mohth, emalysis period at a 5 percent real (i.e*, infla- 
; ^ tionrad justed) amnual rate* Soe Chapter IV for additional details. 

£: o , ' ' ' . " *^ , ' 
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program can then be judged on the basis* of its net present value per 
paurticiparit* , * " * - 

Benefits and costs can be viewed from a variety of perspectives. 
Benefit-cost analyses typically take the "social"* -perspective, whicK 

V ' " ^ . . " : 

values'beneffts or costs to society as a- whole's but ignores transfers 

. . ' .-y^- -r^--- • \- . 

among different gro\:ps within society. . Such analyses speeUc to tihe ^ . * 
overall ecoripnac efficiency of' the program. 

The social perspective is, for this reason, the most iir5)ortant. 

» , - ' 

Other perspectives are also of .interest, however, dependingxon ±he program 

and its objectives. |>erspectives of particxilar regions, the budget of 

the funding organization, or -"taucpayers" generally, are 'some of the ^ 

^ther perspectives sometime's used. Because* of the importance of income 

redistribution to programs for' the disadvantaged, , this report also ^ 



» measures benefits §md costs from the perspective of pfeirticipants^^ auid 

\ ^ ■ ^ ' ' ' ' • - • 

nonpa-t-icipants (often referred to as "taxpayers*). Net present value .. 
from ^he pcurticipant perspective indicates whether they were made better 
off on average by Supported Work' — that is, whether -Supported Work re- 



.distributes income to its pcurticipants. ' . 

If Supported Work redistributes xncome to peurticipants,* it comes 



from those nonparticipants who bear most of the burden of the taxes used 

•2/' 

tp finance the program.— Participants and '^nonparticipants together "make 



-^The term "participants"' here is used to^refelr to those given 
the offer to participate in Supported Work whether or not they in fact 
did so. Thus, "pardicipant* perspective" is used instead of the technically 
correct but stylistically awkward "experimental perspective." -All estimates 
.presented below^^are' for the experimental group^ as a whole, hot just those 
who, g.ivep the opportunity^ also choQja^to participate. 

' 2/ 

) -''Participants dlso pay taxes so we have avoided the more common 

-•re^m^' taxpayer" in-refe]^ ^ _ y * 
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up society. Thus, benefit^ cuid costs frpm the participcuit and nonpauctici 
pant perspectives must ^;in to the corresponding benefit or cost from the 
•perspectiye ^f society as a whole.. Table I.l presents the accounting 
-fraSBWork for the ancd,ysis. It lists the principal components of the 
cmalysis as benefits or costs based on prior exsectations concerning 



♦ tKeir impact from the .social perspective (or, ,for thosfe with no social 

♦ iinpactr from the nonpeurticipcuit perspective) . The second cind third ' 

' 1/ 

♦ columns show their expected inpact from the other two perspectives. — " 
The pextic^pant and nonp2urb4ci^ant columns must, in cmy case, sum to the 
social column when the actual -estimates axe made . 

A- program can only be evaluated relative to some alternative — " 
another program for the scune tcurget group, a set of other programs, (5r 
no program. In this evcd.uation, Supported Work is compcired to the set 
of programs generally ava'ilcd>le to the tcurget groups at the time of the 
demonstration—CETA, WIN, AFDC, etc. 'Thus, the estimated benefits' and 
costs are not thosea-of Supported Work compared to no program, but those 
of Supported Work con?>5ired to the array of conventional programs for 
which the target groups are also eligible. Thus, the benefits of ^ 
Supported WorJ^T could fcd.1 short of cost's as measured in this report 
^ because it is less effective than the array of conventional programs 
rather » than because it is ineffective in ^ absolute sense. 

D. ESTIMATING BENEFITS AND COSTS ' ' 

< 

> 

Data for the cmalysis come from a variety of sources, which are 
also indicated in Table I.l. .To measure Supported Work's effects, a 



^/^ . For a npra complete discussion of the accounting framework. 

See -Thornton and Long *( forthcoming) . t / 
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TABU r.i 

SXPECTEO EfPtCTS Of 30(IFIT-CCST ANALYSIS C0KPON8KTS* 3Y ACCCWTllIC PERSPECTIVE 



Accduntiiu? Ptri^ctiv 



Social Participant ^tonpAr^ip4nt Data 



Sourca*'' • 



Sanafits 

I. .TrodticA by Pardcip^ta 

• Ji^ua'of in-pro9tpi| output 

a :aa:aasad-90St«pro9raB output 

• Prafaranca.for vork avar'w«X£ara 

n. inc^aasad' Tak Payiiants 

«:n* RaducadrOapaAdanca' on Tranafar Pro^ama 

a Kaducad tranafer payaaati 
a Kaducad adainiatrativa coata 



tV« Radi^ad CrladaaX Activity 

a Raducad proparty daaaga and < 

paraooal injury 
V Raductd stolan proparty 

• Xaducad juatica ayatas coata 

• Raductd paychoXoqicai coata » 

V« - Raducad Drug and Alcohol Oaa 

a Radticad traatmant costa 
, a PsychoXoqicaX bahafita ^ 

vi« Radocaid asa of Altamatlva Education* 
Training, and CapXoyaant Sarvicaa 

a Raduc^ aducation and MpXoyvant coata 
a Raducad training alXowancaa * * 



s 

I«p 

0 . 



•r.p 



i.p.s 
u 



I*? 
i.p- 



VII « Othar Banafita % 



a Improvtd participant haaXth' itatua 
a Zncoma radiatxibution 




ating Coat ^ ^ 
^ » ■ 

a Oyarhaad coat 
• a Projact coac 

II. CaneraX Adainiatrativa Coat^ 

IIlA Participant Labor Coat 

-a>rn-progra»\aaminga pXu« frl nga^ 
a roragona aaminga oJrtTa ^rlngaa 
a roragona nonaarkat|activiciaa . 

j 

r;. Ineraasad Mork RaXatad Gout 



A«S 
X*3 



3 \ 



I«S.A 

U 

6- 



a Child cara 
a Ctijar . 



. : - .- . — ^pr- 

NOTE: The cooponanta hava baan liatad 'undar ^banafita" or "costs" according to vhathar thay -x^ra axpactad 
to laad to banafita or coata fron tha social parspactiVa. Tha contrasts batvatn tha txpactad 
tffacta fro* tha social parspacriva and thosa £ron tha participant and nonpar tic ipant par^pactAvaa 
ara shown by Indieaeing* for <acn co«!ponant« whathar tha nat iapact is to'ba a nat banafit (^)« V 
nat coat (•) # or naithar» (0) . ^ • » 

i^'^Tha codt* uaad for data iourca-arax S-spacial study, I-incarviaw data, ^p-ptlblisbad data.sourca# 
A*$apportad vtork accounting systan data* U-'iiaa not cuiasura^. 



;.':3' ... • - ■■ •■ ■ 

sM^le; of eligible applicants for Supported Work was randomly assigned 
" : either to an "experimental'* group ^ (in which case they were offered the 
opportu!iity\o get^a Supported Work job) or to a control group (in .which' 
case they were not)". All those who went^rough this r£indom assignment 
process were scheduled to be ^interviowedr* initially at<the time the 
assignment took place anc^ subsequently at g-month ihtervals for up to ^ 
" three yeaurs. The basic program effects (outcomes) are then measured as 

, ^/ t±e differences between average experimental and control groi^) outcomes 

* ^ 

as reflected by the d^ta^collected in the periodic interviews. That the 
.measxired program effects are based on a controlled experiment with random 
assignment to experimental and control groups is a very important feature 
of this evaluation-. As discussed, in" Chapter VIII, most evaluations of 
enployment and training prqqpwrcs have not used random assignment. This . 
"omission intro'^ueed poiiential biases to estimates of program effects. 

The Supported Work outcomes ^are valued in dollars by multiplying 
each by an estimated dollar value per unit based on £)ublished government 
data,- our om special^ studies, and the published and unpublished research 
^ -of 9thers. In estimating these dollar values, we have attempted to' 
' " identify the marketi value of the resoxirces used or saved, and the o.utputs 
produced by the progtam. We have tried to use this "resource cost" 
approach consistently to-»val-ue benefits 'and costs throughout the^ analysis, 
in the case of arrests, for example, an estimate of the average criminal 
■justice system cost per arrest (derived from the national average data 
^d a published study, of cost by type of arrest)- ii the value per unit, 
which is multiplied by the ex^erimentalTControl differential in arrests 
- . to estimate one potentially iji^jortant benefit—criminal justice cost 
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saivings .resxilting from reduced triminad. activity. Ho value the in-program 

< f 

outputs produced by Support&d Work projects^ estimates were ma'de'of the 

prices that woxild be charged by alternative suppii^s to provide the 

i 

equivalent outputs. ^ * - * * 

> 

A number of potential program benefits and nosts have not been 
valued in the' analysis, because they are either unobservable , difficxilt * 
to value, or both. These include, fdt exair5)le,. peoples'* preferences for 
work over welfaure arftl the potential benefit, of reduced ^|ar brought about 

by a reduction in crime. These unmeasured benefits and costs are'ihdi- 

* • 'X , * 

cated, however, and the effect of not measuring them is analyzed in a 

qualitative way. 

Even for the measured benefits and costs, a great many assumptions* 
must be made. Each ass\2a?>tion affects the magnitude of the estimats, and 
while we have attempted to make the assumptions as 'realistic as possible, 
they should not, be regarded as precise accountings of social net^ptesent 
value." Because of this, we present both "benchmark" estimates of > 
benefits cuid costs emd altematiye estimates that . demonstrate the 
sensitivity of -the results to key assunptions* By presenting thesd 
••sensitivity tests," we hope to .reduce the likelihood- of being misled by 
a single number.* Indeed, it is not the single- result of a benefit-cost 
anarly$ii,^but the proqess of establishing an accounting framework, ^ - 
building up the estimates of the component benefits emd costs, cuid ' 
testing the sensitivity of the resxilts to key assumptions that enables ^ 
one to arrive at a.^summau:y judgment about the' program* s effe'ctiveness. 

• ' ■ V ■ . \ 

The analysis^ has b.een^ limited, to an evaluation of the overall 

• • • » ' 

effects^ of the'progrcun'^n each^of the target groups. • It has jiot 

» * 
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addressed the differences in benefit-cost re^ialts for different program 
CQbponents within the demonstration~for ^xan^le, whether cei;tain types 

of project work sure associatec. with* higher net present T/<ilue thdn others. 

\. . ^ • . 

As such» the analysis^does not 'speak to questions of program replicability^ 




or improved design* 

The anadysis has also^been limited to cm evaliaation o€ Supported 
Work as it Was in^lemented in this demonstration. It has not directly 
addressed, for exan^re, questions about the benefits and costs of^ / 
Supported Work in a fujLl*eii5>lcymenJ economy, or about the benefits and 
costs of a drastically expanded nationctl SupixDrted Work program institu- 
tionalized under CS;TA. Such extrapolSition from the Supported Work evidence 
to. unobserved envixonments or organizational structures ^»would be sxibject 
to considerable uncertainty. We have attempted, instead, to 'base .the 
estimates directly on evidence generated *)y the demonstration. Although 
start-up and evaluat^ion research costs have Been excluded in^tiie flench- 
mark estimates benefit^ and costs are otherwise those- of the demonstration 



wherever it was possibly, to base the ^estimates on the demo;istrati^on*s 
eo^rience. Where this was not possible, as for example in projecting ^ 
benefits beyond the pe^od^when the saii?)le was interviewed,* we have 



attenpted to make the basi^ for our estimates cleair and to test the 



sensitivity of the re^uJ.ts to alternative estimation assumptions. 

..»'•* 

The next six chapters are devoted to filling in the estimates 

ca^i^d. fo2; in the accounting framework in Table I.l. Chapters Xl and 

III docuitient and analyze each of the ^dividual component estimates of 

• " .t • 

costs and benefits during' the" first 27 months after enrollment.. Chapters 

iv: through VII present ovjerall estiiaates of net present v^lue, including 



projections of post-program benefits into the fut^lre,^for each of the 
' • . \ . -J - 

foiir target groups • .The sensitivity' of the results to various assuitptions 

necesscury for the analysis, and the inplications o'f the xinmeasured • 

benefits and costs for the overeai "results » are also' dikctlssed in- these 

... .... ^' - - ■ - , ' ^ " ^ .: 

chapters. Chapter VIII attenpts to conpare the Supportec/work results'^"/ ' 



with the •benefit-c6st results for other ei^loyinent and training programs- 
. cHapterv.]^ is a^ brief suinmary cuid. conclusion. y- " * 

'^'^liis' report is one of a set of three reiated reports on the 
benefit-cost analysis. Two technical reports docimeht the dat^ sources 
cuid metJiodology used in the benefit-cost cuialysis. The first (TKomtqa 
and Long, "forthcoming) documents the methodology and data sources used 
to'v2U.ue the effects of Supported Work, primarily the benefits discussed, 
in Chapter III. The second (Kenper and Long, forthcoming) documents the 
methodology used to estimate costs cuid value of in-program output dis- 
cussed in Copter II. Readers interested in more detail on methodology 
and data sources thari the relatively brief discussions^vhere should- consult 
these technical reports. 





\ 
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CHAPTER 11 



COSTS AND VALUE OF /IN-PROGRAM OUTPUT 



. * . . The costs of Supported Work have Joeen divided, for purposes of 

- — ^^einalysi^T ijatp 't^ exclusive categories: 

- * * ' - ^ ^ . ' 

Project cost is the cost of all ^Jiputs provided by St5)ported Work 

- and used directly in. the production of goods and servicers on paurticipants* 

in-progranj jobs. iThese inputs], include materied's, supplies, transporta- 

* . - ' ^ ' . • 

* tion, equipment, and supervision. ^ ^ " 

* Overhead cost is'' the cost of office space, ssLLaries of staff (other 

them work project' supervisors) and other costs incurred in rciising fiandSr 

' ' ^ 

. . creating jobs, recmiting and later placing participants, providing 
supportive services, and generally , managing the program and its work 
projects. Project and overhead cost are mutually exclusive and together 
make up the program operating cost (other than participant labor) at the 
site level. 

. Cential administrative cost is the .cost of funding Supported Work 
sites and ^ronitoring the prograun at the national level. In publipL'* 
employroiht r.id training programs these fxinctions are normsdly performed 
by the federal gov >mment? in, the case of Supported Work, they are done 
-by the Manpower Demonstration Research* Corporation (MDRC) , which is 
responsible for running the demonstration. 

Participant labor cost is the in-program cost of participant labor 
and /differs depending on the perspective taken. For nonparticipants, 
it is the wages plus fringe benefits paid to participants by Supported 
W6rk. For society as /a whole, however, the real cost is the output 



participants would have produced had they not enrolled in Supported Wbrk. 

Participant labor' costs from both perspectives are estimated below, 

^ . • - - 

Increase d child care ^st is incurred both during and aftei^'^the 
^ " " . . N - 

protrraa because parti^pants work inore and hence some must bake alternative 

arrangements toi\ the care of their children • 

.... - ' > 

Unmeasured^ costs .include' increased work-related cost and foregone 

leisure. These are discussed but not meaisxired in l?he analysis ♦ 

Valufe of in-proqram output s although not a cost, is discussed in 
this chapter because of its close association with costs. It is the value 
of the output produced on the Supported Work jobs, while participants eure 
enrolle^d. 

- As rioted in Chapter the estimates presented here ar^, tb^ the 
extent possibJ.er for Supported Work as it was implemented in this demon- 
stration. . This principle ensures that the benefits and costs can * 
appropriately be compared with each other. We depcirt from this principle 
in calculating our benchmstrk estimates only to the extent of excluding 
eveduatidn reseairch -amd. start-up costs. ^ ' '^-r^ 

Eveatiation research costs have been excluded and the average . 
employment and training program reseaurch co.sts siSSb^uted instead. . 
B^ause Supported-Work is an experiment, its evaluation has be^n nore 
^rigorous and expensive thaui ther^ average for employment and,t*'aining 

progr^j;rf^ei:<frally. To include these atypical evaluation research costs 

" \\ 

J , .'"'^^ 

in the estimates would, in our judgment, give a misleadingly high e^imate 
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' " 1/ 
of ^the- cost' of /Supported Work.-^ 

Stort-up>costs~those add^^ costs incvirred in starting any 

. grgahi^atiion: a^s it makes mistakes r learns > emd grows to its plajmed size — 

rhave:;bcen^.excluded.from the benchmark estimates on the basis of a similar r 

tiibu^ii, somewhat less clear-cut, argument • How start-up costs should be 

•teeated depends on the decision being made. To the extent that such 

costs do not generate' any additional benefits (other thaii getting the 

pTOgrfun: iihderway) /. theyj are only of historical, -ijiterest insofar .as th^ 

-present Sx^jported iferk /ites are concerned. They are irrelevant to^ 

\^ ^ • *- . • * ■ . ' 

whether the benefits of continuing Suppprted Work -are likely to exceed 

» * • - <. 

the costs and, hence ^ irrelevant to a decision to qontinue the demonstra- 
^tion sites. If higher costs- during earlier periods, however, result in 
a more effective^qptogramr— for example, if srall initie^. scale and more 
intensive supervision xneant greater individual attention for participants 
^^j^xich, in turn, increased their ppstrprpgram en^Jloyability — then th*ey are 
not entirely start-up costs and should not be excluded when deciding 
whether to continue Supported Work. If expanding the progr^am by adding 
hew sites were the issue, then start-up costs (cunortized over -the expected 
life of the sites) axe relevant (although they might well be lower than 
the startr*up costs estiiriited for this demonstration) . Although estimated 



If the evaluation research^ has affected the benefits or other 
costs of Supported Work (for exan5>le, by improving feedback to program 
operators) , th.en excluding them would 'be inappropriate. We do not 
believ^^ however, .that the evaltiation reseaurch has greatly affected 
the benefits, and costs of Supported Work. during the evaluation period. 



start-up costs- have been excluded from the bencluMu:k,:estiinates, estimates* 
that/include included as a sensitivity^ test* 

A.- jBTOJECT COST 

The *|)rojects oh which par€iclpants work while enrolled^ in ' 

Sifl?ppirt:ed itor^ vary widely iai' their si^rvision and nonlabor input requirerr 

.'^ ^ ^ ' ' ^ ' , • ' *^ ' • ' /' ' 

ments. At one extreme^, the placement of a single participant in a clericed 

♦' » ' ' ^ * ' ' . , ' ■■' 

..position :in am^ agency; under tto agency Vs day-t»-day supearvisioh 

f?<Ti2iires relativeiy little sl^rvisbry'and nonlabor 'project inputs by 
Supported Work* At the other ^extreTC a gas statipn project nrn by 
Supported Work requires substantial nonlabor inputs--gasoline/ the 
station itself, parts, and equipment — and detailed supervision. ' Al^though 
the expectation's less strong for an employment and tradning program 
>tihan for a private firm, one would expect a project? s inpiits (and hence, ^ 
project cost)^^ be directly related to its output (and hence the value 
of that output) • Indeed,* one way of vieMng the value of in-program W 
c^tput Is as an offset to cost ra'ther, than as -a separate benefit. 50 
ensure consistency between the value of output and project cost estimates, 
the data: have been obtained from the sauoe source-- a. sample of case 
sttKiies of work projects. / . ' ' 



What .goM start-up cost is, of course> a matter of 

•jud^iient. . is techhicaily dx^f ic^ distinguish from the high 
cost 4ue to small scai'e ^ihefHtible eatrly in a progiram^s 
•Mqredyer^ the length of-' the '^^^^^ mambigtipuii. We 

have generall^^^ tried to rely on thirdTyear data (the last year avail-, 
able) for the cost estimates'; thus inplicitly assuming a two-y6ar 
"start-up" period. 
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.. .. Piaici^ value on the butpivt produced by the Supported Work 
.projects- ihyolyes jud about ^spcie^ willingness to pay 

jfoc -*^ ihlierentiy 'subjective and about which 

;pi^ple .m reaTOna^iy 4i . To avoid such .value judgments about * 
.spciity '.3 4^!y"^4\:fo^ tjic; pro ject pul:put> -we have used: as the benchinark 
;egtiwtf ^the amount am . alterative. :su^ would cheurge for output 

.eqidVa^^ Suppprtejd Work project. This 

procedure is consistent 'tf^th the resource, cost approach to valuing ^ 

^ . 'V. ' ' ^ ..' ^ * " , . 

- - • I" ^ / . , ' . ' ' , ' • 

Ib&iefits and costis, which is used throughout the smalysis. 

The "altemattive supplier's price" may not represent the amount • 

society would , in fact, .be willing to pay for the output. (The traditional 

exainpie of make-work where the alternative supplier's price and society's 

willingness to pay differ is the work crew that digs ^ditches only to fill 

'them. up again. While an alternative ^supplier would certainly charge to 

; ■ , ' . r,:'-^ ' ' " ^ ' ' ' ! 2/ 

perform the Scune work, society would not ordinarily value this activity.-^ ) 

As a. way o]^ ^asuring value,, however> itf^ still has importauit advantages. * 

First, the alternative supplier's price is an easily defined concept that 

cah^ be measxxred objectively. Second jl although tJ\e two are not conceptually 

the same, Idiere. is a theoretical justification .for considering, the ^ / 



7^T^ is that, developed by Friedman (1977); ^ 

for a^ disctissi^ fratnework, see^ also. Kemper and Moss 

11978) i-iidK^ / 

• \ '-2/"" ^ ""^^^ - V ^. . 

/ ,1^ Society: M place- a pQsitive value on having people work, 
:^n their Jjayin^^ ijicome frpnirwages, or dther benefits of their 

■empioyment.'* %iese ^^enefi^ "value of 

.dii^t'r.te refers tb tt^ att^iched to the^-goods and services per se 

•prdtduceii; on Supj»^ ' 



« > 



an upper bound estimate of the sociaa 

,l^i>f f it .1br"t^^ Pinailjr, ^examination of the case* 

st^ftdies; Of p?^ects in.?ia.ght of this' theoretical argument leads us to 

conclude- that the benefit' to. so:ciety^ from the increased output is 

P^P^^^ly far beldW^the' altera supplier's price* 

Although the alt:erhat!ive .supplier's p?:ice is theoretically a » 

wellj^Afined concept, its measurement is riot always straightforward. The ^ 

measorenient methodology is fully documented an the technical report, and 

. ' '^^ ^ ' ■ ^ 

the details of specific estimates are documented in reports on the 



\ 1/ . - * ' ' ' 

, This economic argument, Tnad^ formally and in detail in the 

asspciated-, technical report (Kenper" and Long, forthcoming), c^>be , * 
sv^fiarized as follows. • Twoltypes of output are dis'tinguishedu' .Supported 
PV^tput that siibstitutes for output that would have jDeen produced in 
the, al>sence of the program and the output that represents am >:q)ansion of 
output: bWyohd that which would 9the.rwise have been produced. The mechanisms 
through which societ;y benefits are quite different for the two kinds of 
^^'^'-^''^^ * V output. • ' . . - , . ^ ^ 

Society benefits^ from output' that siibstitutes because the resources 
' that would* have been used to produce the output in the absence ofSupported . 

^ Woirk, are freed ^ pro^^^ elsewhere in the" economy.. Inr-«^noothly 

• jjr , _ ^^fipj^f^g economy, these resQiirce^^ can immediately move to their most 

\ ^^^u%le;»altei^^^^ tJie value of this, new output will* be equal 

\ . 1:0 the altemativ^^^ In- an- economy, where-, thfere are. con- 

;( stiai^ts th JTesourcies from one uae to 

^ F*^?^^^'^^ the . new output , will be 

... - . ^ ' ^^^^'R^^ easting; output, the benefit to 

' • ^P^?ty is;.det^^ the 'new output. As long. 

? : ' ^ , ^- "^f y^^ ?^^?^^?f'^^^^ t4\3in the price coi>sumers are 

'^^d - V to pay- f^ to ea^and in the 

' ' ad^i^ence .The fact that oiitput only ^xpind's when 

T supported' <tork: e^^^ narke^^ thus an indication thit 'the vklue of ^ 

. PV^tpiit' to-sbciety; must: be, less than the: alternative supp i 

7 , ^ y^fhis.con^^ of assumptibjis. the 

P^st iii?^rt£m of w^ich; fs^toat resources , freed by Sujpported Work output 
t^^^ s\&s^titutes^ othertlrise be6n done by regular 



0 ' O 



te'^- ^- ^ ' ' ^ 



individual case studies;— The alternative supplier's price was 

:measurid ^t«ing-se^^^ techniques: 

:Bids. , When a contract was awarded ^to a Supported Work site through ' 

jTO%g«titive bidd^ the next highest bid (i.e*, the lowest nonprogram bid) 
provided a direct estimate of the alt;emative supplier's price. 

Revenue .niark-^up^ When Supported Work sold its c^tput in regular 

:marketsV ^the revenue received provided a basis for estimating the altema- 
tive. supplier's price* The. ratio of the average price charged by other ^ ^ 
firn^ in tJie^ xt^ to Supported Work's prices was used to "mark-up" the 
Supported Work revenue to obtain an estimate of the amount an alternative 
supplier wuld charge for the same output* * / 

"^-iir p - ^ndent estimates * Wh^re output was not actually sold, 
indirect. estimates ha3**te*4^made . One means of *doing this wa:^ to have 
ihdepehdent estimators—professional estimators in the industry in which 
the work was done— provide an estimate of what^^ alternative 'supplier 

would charge to produce the same output. 

* . - i ^ 

i Production 'Standards* Another indirect method rel4^ on published 
— Z ^ ' 

estiiJlating guides available for many industries. These ,g\iides contain 
estimates ot the lcd)or and materials required to perform various tasks— 
such as painting 1,000 square feet of wall or mowing lOO square 
yards of lawn. ^By measuring -the tasks necessary for the job, determining 
the. alternative supplier's wage- rate .and unit materials costs»*and apply- 
ing, the production standards , estimates of the alternative supplier's 
"'price were constructed. 



^ These stu<iies, are available oh request 



from Valerie Leach 



Relative productivity > This methoji relied directly oil an estimate 
of the productivity of supported workers relativg. to that of regular 
workers. .The estiinated. ratio, was, then rnxxltiplied by the hours worked by 
the .pajrticii>ant to estimate the hours that reguleu: -/orJgers woxild take to 
^ the same work.-i/ This estimate of "hours Was then multiplied by the 
regular workers* wage -rate (marked up for fringe' benefits) to. estimate 
the amount that wouiaj have to be paid to alternative workers to prc^duce 
the' same amount of oufeput* r ' * ^ 

Aithbugh conceptually sin?)ler than estimating the alternative 
supplier's price ^ estimating project cost (the second, major task of the 
case studies) is just as iir?)crtant since e^ror in the measurement of ' 
project cost can affect the c^veredl results as much as error in the r- 
measurement of value of output. The Supported Work fiscal and manage- 
ment information systems were designed so that project costs could be 

accounted for on an individual project .basis; these accounting data then * 

— ^ 7// 

formed the b^sis for the cost estimates.— . * • • - ' 



1/ ^ " " 

-7 The relative productivity estimatk is based veuriously on work 

measurements/ conparison to previous lcQx>r. requirempnts, or the^ assessment 
of supervisors. ^ 

, 2/ ■ •* • • ' V'. * " • " ' " /^.* 

* / • \-T"PaJ^icip5^^ hqwcs and wages were chained to projects on . » 

Weekly time shieetS/ emq other project costs -were routinely assigned to- . 

inc^Vidual projects fcy the program accountant.* While the. fiscal data 

fprrod the basis for'^estimating project* cost/ adjustments were often 

i^?quxred for the pioiposes of this study to make sur^sthat tw. J>rin<^iples 

were; follbvfed.^ ^1) Project ^costs must ^o^^ outj^mts valued. 

(For eicauTflple/ if a construction pirbject* took three auid.one-hsilf weeks to 

coi^lete/ the project costs sfiotild include the cost of materials used * 

ditting the same three and onfe-hairf weeks^ whether they were- purdhased 

specially for the project/ dra^wn from the site's'*'"^isting inventory/ or 

cbri^riiuted^ by the customer.) . (2) Costs' must 6e. charged t6 projects in 

such a way that if all prpjects at a site were studied/ the project cost 

estixnated for the projects on a case-by-case basis would sftim to the- total 



• since tiie projects studied varied in size and ip.the length of 
time they were studied, the value o£. output and project cost* e&timates 

were standardized by dividing by the number, of participant hours worked 

V '''''' . • ^ \ — **, * ^ 

on- the. project.-* By estimating value of output and project cost ou a 

-per-hpur basis, the results^ of the case studies .could be averaged and 

• , . . . ' , , ■ ' . ^/ 

ultimately related" to^iother benefits and costs^;--;;, * 

Because value^'of output e^d project cost data are ej:pensive to 

' • > "t 
collect, detailed estimates were only made for a relatively small sample 

•of projects* Initially/ whileS^e measurement methodology developed by 

Friedman (1977) was adapted to Supported Work., projects were chosen for 

case study judgmentafly^ As the methodology was extended and refined, * 

> * • 

we shifted .to a random sanqpling of projects designed to be representative 
of total hours worked on projects by participcuits.- 

The -resulting siut?>l§- consisted of 58 observations (33 judgmental 
and '25 randoir) of 44 different projects. - (Ten projects were studied two 
or nore times, accounting for a total of 14 repeated obseirvations . ) 



project cost. at the site. (This would not occur, for exait^le," if the 
site failed to charge the cost of vehicles shared by several projects T 
to the individual project accounts but instead charge^ theni to an "in- 
direct" .cost account. In order to satisfy this "adding up" principle 
ih the ca'3 studies, such costs -v/ere allocated to projects.) ^ 

i/iphese hours include only those hours actually worked on the 
project; they do * not inqlude vacation^ sick leave,, holidays, time spent;, 
in ancillary services, or other time not spent working on ti\e project. 

Measuring project hours was usually, but not always, a single 
matter and it, too,, is' subject to measurement error. ^ The MIS time sheets 
' formed the basis' of the esttimate^ but they sometimes had to be adjusted 
for misreporting or differences in pro jec^definition. , 

The sfample selection procedures , the representativeness of * 
the:san?)le, and sample • exclusions and reweighting are described in 
detail in Keaper and Long (forthcoming) . • ^ 

• % 



Although tihe sait5)ie was concentrated iji the second emd third years of 
program operations, 11 observations were studied during the first yeatr. 
One woiild expect value of output to increase over time as sites gain - 
experience and irdn-^ut start-up problems. Examina'tion *of results (not ^ 
shown here) shows that thi^ hypothesized increase in valu^ of output* 
(net of project cQst) did indeed occur over time. Sinct start-up costs 

ar 4 eliminated from. the benchmark estimates, projects studied during the 

' * ^ ' lA • ' • ' - ' . 

first y^ar of site' pperatibns-^ were not included in the san^le reported 

. ^-2/ • ■ ' ^ • 

on here.-- ^ In addition, one e\tremQ outlier was excluded* from the 

I 3/ 
results reported here — which are, therefore, based on 46 observations.— 

This sample turned out not to be representative across sites. 

Given substantial differences among the sites with respect to the type of 

project undertaken, management style, an<^S^#of target groups that might 

cause differences in value of output (net of project cost) across sites. 



1/ ' ■ V\ • ^ - 

— Some number of. new projects^will be initiated each year even 
in ongoi^ig programs. The argument being made^ is that projects studied 
during the first yecu: of site operations should be excluded; projects . 
from later years studied during the first year of a specific project ' 
should not be^ systematically excluded from the sairple. ' ' 

2/ * -tsif^ 

; — The full sample is analyzed in Ken^er and Long (forthcoming) to 
which interested readers ^^4x1 refer. In general, benchmark estimates have, 
been based 6.1." third year costs. TO do so for value of output and project 
cpfi^ts, however, would reduce an already small sample size even further, 
'SO we have used the second emd third ye£j: con4)ined. 

3/ • ' \ • ' 

7^ The excluded project, an effort by the San Prcuicisco site to • 
develop, a solar panels ijostai*lation project," was studied while the proto- 
type was being installed,' inuch of the work^-being done by a hired con- ^ 
sultaht. OSie" project did not get beyond this, initial prototype stage 
•before "it and the S^ Fremcisco^site were closed. It was, thus, an 
unusual project which was- quite small (accounting for 2Qx)ut 0.4 peicent 
^of »*the;h6uts at Sah Francisco during the third ygair) . The estimate for 
jbhis rproject lies/ six stand^d deviations below the sample mean. 



we have reweighted the sanple in confuting averages to* be representative 
• of the actual site sizes. 

? * ' . . » 

1"^. Results 

The resulting estimates are presented in Table 11^ 1. .The v^eighted - 
average ailtemative supplier's price was $4.58 per hour and the average pro- 

ject cost $^.98 per hour. The difference between the twor-which is 

• ' ^ * ' ^ 1/ - * 

what affects the overall benefit-cost results— was $1.69 per hour.— 



*^The aiter;^tive% supplier's price per liour veuried considefaibly 

i ' *. 

:^"-. rf * , \V.. . 

across sites Some of t^i§. varmtion is due simply to differences in the 

project inputs across sites. " Hartford, for exan^le, had the highest 

alternative supplier's price per hour but it also had the highest project 

cost per hour; both were partly the result of the type of project undertaken 
• • • 

Haurtford—manufacturing, repair, and retail service pxfojects requiring 
* " • • ^ ^ • 

extensive nonlabor inputs. Hartford's gasoline* station project is an. 
extreme example, where the cost of the gasoline itself caused both 
project cost and the alternative supplier's price to be^high. . 

Even when project cost is subtracted f;^m the alternative ^ 
supplier** s price to *^^ount for these differences in inputs (see the right- 
hand column of Table II. 1), substantial variation across sites remains* 
apparent. Thrf variance is,- Sf course, even higher in the underlying data • 
on individiiaT projects. This high variance, in combination with the small 
num^^er of observations;, implies that there will be considerable uncertainty 
surrounding estimates of the value of outpdt and project cost con^jonents 
*'of the benefit-cost amalysis. 



^ This should not. be interpreted -to mean that the projects, on 
average, pay for idaemselves. Overhead and participant labor costs are 
exclude4 from *this calctilation; 
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.TABLE irA . 



ESTIMATES OP ALTERNATIVE SUPPLIER'S ERICE AND PROJECT COST PER HOUR 



Site 


« Number of * 
Obser- 
vations 


Altfdmative 
Supplier's 
Price per 
Hour 


Project 
Cost per 
Hour 


Alteirnative « 
Supplier's . 
Prige' minus 
Project 'Cost 
toer Hour 


Atlanta 


4 


$ 2.'94 


$.39 


, ' $2.55 


Chicago 
Har.tford- , 


. A 
12 


. - 2.37 
' ' 5.85 


.77 
5.08*' 


1.60 

.77 ■ , 


• 

Jersey City 


.8 


6.64> 


4.72 > 


'1.92* 


Newaurk 


5 . 


3.80 


.77 


3.^03 


Oedcland 


2 • 


5.34 - 


2.98 


■ 2.36 ■ - 


Philadelphia 


7 


3.98 - • 


4.55 


-.57 


Seui Fratnc.isco 


• 3. 

* * 


/ 2.82 


2.82 


o.op 


Weighted 
Average— 


46 


♦v. 4; 58 


2.90- 


1.69- 



NOTB: - For definitions, of terns and data source/ see text. 

a/ i ' . . ' * 

'^.'7 This is the average across sites * weighted by the proportion of 

years of participant service at the Cities during rt^e tljird yeeo: of site 

operations • / ^ - , 
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312 



• ^* The 'astimates "thus aunrivad at, e^^ressed as they are per project * 
hoftir, caxinpt }^ iised directly in the ben^fit^cdst atialysi^ or cozqp^ed tor. 
oKre'rhead -and central administrative cost estimates, which*'eure e^^ressed 
per year o'f participant se'rvitre^. - (A year of participant service is de- , 
fined as a 'calendar year bf enrollment in Supported Wbrk.) The. per hour; 
yalue-of output and project- cost estimates have; ^erefore^ been converted 

•t^^i^per year of service basis -by multiplying by a. conversion ratio; the^ 



average n\jnber"of project hours worked by participan'ts pe;r year of service. 
, ' Th^ Supported W^k Management^ InfoatoaW^ contains 

>••'•■''*:.■/■ 

data pn ye^urs pf paurticipaht sezfvide and hours worked on projects. Data 
from the^ &ird year of operation . for the eight ?.sites yielded an estimate 
of" 1,31,4" ^project hours 'per year of service.— Using this ratio, the ^ 
benchmark estimates for vaJ.ue of ih-progr4m output was $6,01$, per year * 



of participant service and for project cost: was $3,797x ^. 

In presenting the cost estimates and the methodology used to * 
obtain thenu we proceed con^nent by component. As stressed in Chapter I, 
* the vaurious cpnponents.of the benefit-cost framework aze viewed as bene- 
fits or costs depending on the accounting perspective used. Supported 
Work ^-program linage payments, for example, aze a cost to the nonpaiftici-* 
pants. who finemce them, bu£ a benefit to the participants who receive 



. -^The estimate 6f totkl project hours has been adjuste^d, -based on 
special studies, .to eliminate hours worked on program-serving proje' 
such. as .a' janitorial project to clean the offices of the Supported Work 
prdgram itself. Such- projects ^do not directly benefit society but dp so . 
indirectly, by reducing overhead costs (which reduction is accounted for 
in the measurement of overhead.oost)^t^ Consequently, to avoid isputing a 
direct value of joutput to these projects, tot^^l. project hours were «^ 
adjusted 'dowfiward by^ the proportion of total hours that were .worked on 
progr5aa-serving projects. See the technical report for a fuller dis- 
cussi6n,,of this dssue and the^ estimation technique's. 



them* It is In^rtant to k^ep the different perspectives in mind while 

reading about specific costs. ' . - J 

• ' ' ' ' ^ , \ ' V ■ 

Project cost and value of iji-program output are a cost and benefit 

♦ * \. 

respectiv^jr^y_ to ^both nonparticipants and society as^a- whole. In the case 
of Si^ported Wbrk^ project cost is incurred^ with minimal exceptions, by 

the program itself amd thiis is part of its biidget outlaySf psu.d largely 

«■ 

by nonparticipaivt's through, federal tastes. 

The value of output is an offset to costs from the social and non- 

participant perspectives r but it is not necessarily an offset to StJpported 

work budget outlays. Although customers were asked to pay for the output 

they received from Supported Wbrk,-^* the^of ten, paid less theoi 'the 

2/ 

aLLtemative supplieir- s price.— The .amount paid for the output of the 
projects iise^ to make the benchmark estimate # weighted the same -way, was 
$3,298 per year of service — a little over half the alternative? supplier's 
price. Thus,- nonpa.rticipant? received 'the value of output through two 
different routes. All taxpaying nonparticipants benefited from a. re- 

duct ion in the taxes require'd to fund Supported 'Work because of the 

• > 

revenue it received for its project output. And Supported Work's 

p- 

customers, also nonpaurticipants, benefited because they padd less than 

the alternative stjgpplier's price for the project output. 

Payments for project- output are an alternative estimate of value 
• * * 

of output. Customers have been shown by their^ payment to be willing, to 



1/ ' ; • , 

-^The Supported Jtork demonstration placed a great deal of 

emphasis on , raising local funds, through both grants amd service pro j ect 

revenue so that sites were under; pressure to raise as much revenue from 

projects as possilile. ^ ^ 

2/ • 
~ A qpiarter of the projects in the benchmark sait?)3.e earned no 

revenue at all. ^ 



ji^p^y;^^ least that amount for the project piatput. These payn^nts can thus 
' ^^-^^ed' as a lower bolnijd on socie ty* s willingness to pay for pro-ject ^ 

•,ou^ut,.— Supported ttor^ revenue from^thV^sale of project output will, . 
' '^kzefore, he used: as ah alternative estimate of the value of dutput in 

'^e- 'Sensitiv^^ ^ ' v , 

^ B.. OVERHEAD COST . 

Although the organizations se^t up to run Supported Work in eac^ 
of the 15 sites were typically sponsored by an existing organization (for 
exaii5>le/ the Urban League Atlanta) and sometimes continued to be 

V 

closely associated with it, they were usually separate organizational 

1' • \ • > 

stri^ctures. -These organizations had to raise local matching funds ^ 

create jobs, recruit and later place participants, provide supportive 

services, and generally manage the program and its work proj^s. That 

.all of these functions had to be performed by separate organizations 

2/ 

serving a relatively small number of participants-- meant that substantial 



-—There axe two resisons, discussed .more fully in the technical 
report, vrtxy the anount paid may not be^a lower bound. First, customers 
may make payments, ostensibly for .output, that are intended partly to 
*f si^iport the program generally/ -That is, they may be paying p*arily for 
■ other. benefits (income redistribution, reduced drime, etc.). Their pay- 
ment: cotild tiien exceed their willingness tp pay for the output per se. 
- Second^ cxistomers* willingness to' pay. ma/not )jepresent society's 
I willingness tq pay. The cxistomer is often the government and society's 
willingness to pay must be registered through an imperfect political 
process, which could ov^rs^te '^society's demand for the output. In 
spite, of these cav^ts, there are many reasons to consider it a low 
estimater-and 4e view ijt as such. 

■^/^During .the third year of operations, the average number* of 
.participants enrollied ramged from 29 in San Francis'co (in the process 
of closing) • to 232 in Jersey City, with an overall average of 119.. 



r 



costs were, inciirred: in siioply running the prbgraia^- These costs of mnning 

' Ci' - ^ ♦ - ^ ■ 

Supported Work: have been. Xunqpea~ together here under the single category 

••overhead." Specifically, overhead cost includes salaries of staff 

(other than work project s;:^ervisors} , office space, supplies, accounting 

services, and s\:^portive services Overhead here is thus more ti)an just 

-I 

administrative cost (as is sometimes the case for other programs) • Here 
overhead includes eill s^xb^ operating costs other than participant labor 
-^^a^ .project costs. The Supported Work fiscal systMi accounts for these 
esqpendlture categories sepcurately, and data provided from these accounts 

by MDRC were the source of the overhead cost estimates. To enable comr- 

^* 

parison of overhead cost for programs of different sizes, they have been 

^ .' . 

put on a per year oS^^articipant service basis using MIS estimates of the 

"'^^^ 

number and lihgth of enrollments at each site. 

' Table II. 2 shows that there is considerable variation. in overhead 
cost across the Supported Work sites. Particuleurly striking is the re- 
duction in overhead cost over time, confirming expectations of both high 
start-up costs and economies of scad.e. In line with our decision to 



His^on 



exclude start-up costs, the average overhead costs for the eight sites 



— ^In addition to these management eacpenditures, costs were also 
incurred for work projects that se/ved the program itself-^ for exaB5>le, 
.a project providing janitorial services for the Supportec? Wbrk offices* 
The 'output produced by such progi^uftrserving projects is an interaediate 
input consuoned by the program itself. The prograjn manager thias.fiices a 
choice between using regular st&ff to perform t^e program? s functions or 
ufejig participants and thus- reducing ''tenagement e^enditures- (but also 
reducing the /total value of output produced on projects for outside, 
ctastomers) . '.The.^project "cost of these-program-serying -projects has 
been added to the svahagem^ to obtlatin overhead cost. 

The^project cost ,for prograuft-servihg projects was- estimated on the 
basis of special, studies as described in the' techxiical report. 



--^.A 
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. * OVERHEAD COST PER YEAR OF PARTICIPANT -SERVICE, 


BY YEAR AND 


SITE 






I. 


(dollars) 






1 ' ' 


Sitev \ 


•Pijrst 
" Year 


\ _ , Second - . 


Third" 
Year • ■ 


All 
Years 




A^^ta 


'6,801 


3,186 . 


2,946 


3,734. 




Chicagp.. . 


7,735 


4,860 


2,799 


3,993 


i'"}^ - 


• Hartford 
. .Jersey City 


7,128 
5,984 


4,480 
2,839 , 


3,239 
3,363 


4,009 
3,539 




V Newark 


9,022 


4,091 


^ , / 


1 7*7Q 
J , / /O 




Oakland 


5,255 


2 ,788 


2,405 


2,991 


^> 


-Philadelphia 


. 6/956 


3,501 . 


3,587 


4,241 


>. ■ 

> 


San Francisco 


7,257 


6,413 


6,404 . ^ 


6,671 




All Sites * 


6,918 


3,827 


3,014 


3,896 - 



NOTE: Data ^e taken from the Supported Work fiscal system combined oper- 
r . ating;, reportsf and tabulations of data from MIS status change reports- 
The dolliaur figures in this and all subsequent tables have been 
adjusted for inflation to the fourth qusirter of 1976 using the GNP 
deflator. ' J ^ • 
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dViriiig/the mrd'ye'ar, $3r.di4'Eier year of participant service, is used 
M^ti^^ :S:uice. id^^ three yeeu: average was, $3,896, the 

i^lici^/ estimate s^tart-v^. cpsts (iii the overhead category) is $882 , 
jpef year of parbicipant service • . ' • ' . . . - 

In addiction to- the project and overhead co^t^« discussed above, 
' . . • ' . " ' • 

^a;^p^»gram like Siipported t^rk incurs central administrative costs--the; 

costs of developing administrative procedures, and 'of funding, auditing, 

arid monitoring the individual sites. As already' mentioned, central 

admiMstrative costs are usually incurred by the federal government foi; 

ptiilic eii5)loyroei^t' and training programs,; in the case of the Supported: 

Work demonstration, however, most of,, these costs were incurrei by the 

•Manpower Demonstration Resea^fliii^Corpora^fion. MDRC incurred expenses 

for inauiaging the. field operations,, maintaining the program's fiscal 

system and' management information system (MIS), and. supporting the 

.evaluation research. \: - . 

Table' II. 3 presents, central^a<3ministrative costs for the first 

three years, broken down iiv^o tJiree '-^at^^^ . MDRC central .staff and 



overhead; subcontracts for the payroll jX^cpbilnting, and managiement inr 
foriMtdon systems; and the subcontracts for the evaluation research. 
Sejparating the evaluation research cost from other costs,- like most 
.furictipna^^ of costs^ is not ^ simple matter amd requires, 

numierbus assumptions. However, using da:ta supplied by .MDRC, ,we have.,made. 
such estinpates. Excluded from central administrative cost are all of the 
fesearciir^sxjbcpritxa^^ that f>art.of the MDRC operations cost devoted to * 



'MpjWI CENTPA^ 0;p PARTICIPANT SERVICE 

• *^'. (ddllars) ► 



0>' -tri- 



V 



, Firist year 



Second Year 



Third Year. 



All- Years 



yActuaL;fecpehditur 

Central 
' : Fisbal>^Mfs Su 



f ; , ' Centra 

' ' :Fiscal>^Mfs Subcpir^fi^actsr- 
i. ' rResearchrSuixjphtrac • 



Total 



1,539 
1,521 
3/901 

6,961 



598 
306 
1,884 

2,788 



469 
140 
.1,270 

1,879 



: 676 

408; 

iv^92 

... 

.2,976 



<^ ' vK5- ' . , ' d/ 

^ 7 Expenditures Excluding. Evaluatioh Research^ ■ 



.Central MDRC Operations- 
Fiscal/HIS Subcontracts 
Research Subcontracts 

Total 



1,297 
868 



2,165 



^94 
175 



669 



379 
69 



448 




SOURCE: Actual expenditures fran MQRC (1978a), Tables VII-1 and VII-4, for the first and second years; MDRC (1978b), 
p. 20, arid supplementary .daCta supplied by MDRC's Fiscal and Budget Office; 



a/ 
b/ 



This category includes MDRC staff and overhead ''expenses incurred in connection with Supported Work, 



Included^ in this category .are the cost of subcontracts for the payroll, general ledger, and management 
information systems, y . ' ' . * . 

c/ ' ' * ' • 

— This includes 'the costs of the evaluation subcontracts\ * ^ 

d/ 

— For details of the methods used to estimate evaluation research, see Kemper and Long (forthcoming). 
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evaluation research , and that paurt of theVMIS subcontracft devotr \ to the 
work-project and iabdfrinput data required for the evalxaation reseaurch. 
An estimate of probable evaluation research cost of;!^ typical program, 
based on the average; evaltiation research .esq^enditure for CETA programs— 
that is, 6 percent of central administrative cost — has been used instead I 
As can be seen in^y.the table, the-^ evSauation research accounted for about 
75 percent of total central administrative expenditures, leaving eui 
averai^e over the three ^years of $786 per year of service. 

This, three-^year' average still includes stsurt-up costs,- which must 
now b^ excluded. TcQjle II. 3 shows that cost fell rather sharply over time 
largely as a result' of increased scale, which ;.siupports the hypothesis that 
start-up cost is important during the early implementation of Supported 
Work. Even the third year involved some start-up due to new "sites in 
New Jersey and Wisconsin. Based on estimates supplied by MDRC of staff 
salary* costs by administrative function during the third year, we estimate 
that $83 of the $448 third year cost was devoted to start-up activi\:ies, 
yielding a benchmark estimable of central administrative cost of $365 per 
year of service. Since-, if start-up cost is included, the average for- 
aiH years was $786, the implicit estimate of st2u:t-up cost is $421, just 
over half the total. ^ C. - 



This benchmark estimate of central administrative cost has 
required that asstat^tions be made about evaluation research, start-up, 
and special demonstration costs. It is useful, therefore, to compaure- 
these estbiiates with the central administrative costs of established 
programs. ^'^l One estimate of central administrative cost for an 




^;See' Kemper and Long (forthcoming) for the basis for these 
estimates. • * t ^ ' 
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estab^shed pragrw.c^ be obtained' from the Departc^t o( Labor's - 
fiiqplloyaM and Traiining Administration's cost of Managing OBTA programs. 
*i-aitdj»te of this cost for CETA pvtolic service employment was $164 per 
.y«ar of service :in fiscal year 1977, iess than hatlf the Suppoi^ed Work 
benchmaadc estimate. Differences in, program purposes, operations,, and 



scale make this estimate, almost certaiM,y on^^the-low side, especially 
:since the centfral administrative functions are performed or 

perha^pf diq^ locad prime sponsors. 

<A program more comparable to Supported Work is Job Corps. The 
••general administration'*, category of the Job Corps federal central, 
adnijdstrat^^ expenditures amomited to $623 per year of service in 
fiscal year 1977, about 70 percent above^ the estimate for.Siipported Work. 
Job Corps central management cost may be higher because Job Corps has 
s\abstantial physical property' and provides extensive Residential 
^services, which requires more central monitoring and control. 

The extent of central monitoring and management is a potentially 
important policy choice, and the CETA and Job Corps, eacperiences suggest 
.the range ofi^'central administrative cost observed in established federal 
programs. The sensitivity of the overall Sifl?ported Wbrk cost estimates 
to these aS?temative estimates of centraLL administrative cost is tested 



later in this chapter. 

D. PARTICIPANT LABOR COST ' 

In addition to the program operating and central administrative 
costs disctissed above, Si^)ported Work pays participants wages and fringe 
benefits ^ile they are enrolled. The outlays for wages were estimated 
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. " . , TABLE'11.4? 
PARTICIPANT JJVBOR COiST, BY TARGET GROW 
(dollars) 



APDC. 1 Exraddicts Ex^ffanders 



Youth 



Per Year: of Service - 

iii-pratgram earnings - plus 
-i^ friiiga. benef itis- 
z^oragone. eaur. ings -plus' . 
• fringe biih^f its 

Net increase to 
■ participants 



6>473 
1,175 

5,298 



6,770 
2,188 

4,582 



7,274 
2,232 

5,042 



6,304 
1,734 



4^570 



Per. Participant 

■ pi-prograin eaurnigns plus 
fringe benefits . 
Foregone ieaumings plus 
.fringe benefits 



fet increase to 



P2u:ticipants 



4,856 
• 879 

3,977 



,3,777 
1,219 

2,558 t 



3,589 
*1,1Q0 

2,489 



3,551 
974 

2,577 



IKyPE: Ih-p^ogreun earning^xplus fringe benefits per petrtieipant are the mean 
^ supported work earnings of the experimental group, xoarked up by 12 
percjent'for fringe belief its cuid discounted to' the mid«*jpoint of the 
' .first 9^montK pjbrxdd at a '5 percent emnual rate* Foregone earnings 
' per ^participant are the mean ^eariiings of tHe control group di^ring 
eaclL 3f*-month period imiltiplied by the mean proportion of the period 
tluit experimentals were in Supported Work, summed over the 

— period'-and-^iaarked up by. JL5..percent_for,^^^^ Thep^r year 

of service estimates were obtained by dividing undiscdunted figures 
by the average length of stay (in years) • 



.tihe foregone output that participants would, have produced in the absence 
of the prdgram. The earnings plus 'fringe b«inefits of the control grov?) 
is— under oustpmary, and we believe reasonable, assun^tions^.— ' 
appropriate^ estimate of the value- of this foregone output to society\ 
These" foregone eaorhings axe estimated to correspond approximately to' 
'"tiM period participants spent enrolled in the program.-^ . j,. 

The earnings of the control group" demonstrate- that Supported'^ork 
has been unusually successful at targeting the program at disadvantaged. 



1/ ' • ^ • • 

The required assumptions are*: (1) Firms hire workers up to ' ' 
" the poi^t where th€j, value of the additional output they produce equals-' 
.^fi^'K?ge rate ''plus fringe' benefits- (2) Firms and organizations ^ 
accurately assess and respond to consumer demand for their output* This 
is especially ia^ortant outside the conqpetitive sectors of the economy 
and in public service empioyment programs. * (See Chapter IV.) (3). There 
are ho indirect lal>or maj^ket effed^ caused by Supported Work, (This 
issue is discussed further in Chapter IV.) (4) Illegal income does not' 
represent a contribution of national output. . -v 

2/ 

--'Participants leave Supported Work after varying periods of 
enrollment so that .thfe •*during-program" period differs from partidipant 
.to participant, captaining an estimate of what participants would have. * 
earned while, enrolled, -in Supported Wbrk becomes difficult because- thos6 
who leave early may differ in ;vJhat they wqul4 haVe earned from those who 
stay a long time. The. average earnings, of ^ control groi^ weights, the 
earniiig* of early and late leavers equally and inay ndt be a good estiaate 
of foregone, earnings 'for the duringrprogram period, which should weight 
late leavers. more heavily .v. Despite 'toese 'conqplexities^, we have xised^the. 
-,Je!ftrage_earhin$^^ earnings - - ' 

, The sp«cific\procediire-UMa WM td estimate/ for each 3-month . 
tJLme period, tlie %wrage* proportion of that three months that experi- 
mentals were enrolled: Ln Supported Work. The, proportion of the control 
grpi^ earhings^tJius arriyiid at was then used as tdie estimate for 'fore- 
gone' earnings of participants while enrolled. (The remainder of cphtrol 
group earnijigslwas, assumed, to Jbe ^e amount that those experimentals whQ 
l^ft the prqgreun .would, have earned and was subtracted from their aon-? 
Supported-Work. earnings to obtain the estimate of tlie change in p<5st- 
program eatings rfor that time period.) Any errors* in' the estimates of 
foregone earxiings: resulting from this procedure for ' months i-18 will be 
of fs€^*t by corresponding errors in the estimation of post-program earnings 
gains. The net present value estimates are> therefore/ unaffected by 
.tihis procedure. - ^ . ^. . ' 



... s ••■ • ' 

' - ♦ . . ' ■■ • • 

workers.. Foregone annual eauniings plus friftge benefits^ ranged fromvabout 

$1,000 for A50C to ^2,200 for.ex-addicts emd ex-of fencers/ with youth 

^. • ^ ' ■ • " ^ * • - 

($1,700), in'' between. These nujcb*rs show cj-eayly t^hat-the Suppoi^ted Work 

participants woiild, in, the absence of the S^ported Work, have had eeomed 

. , . . *^ 

incomes thi^t are. low by any standard.' -It is also iAtfiresting to note^that 

the. earnings of the control group rose cons^istently over time, a trend 

*' ' . * ' • 

that^may be the result of iiaproveinent in the econojoay generally or of the 
gradiwil return to employment "o^ the control, group (who were necessarily 
unemployed at assignr^nt by ^ virtue of the prograoa eligibility criteria), 
or both* Like inrprogram earnings, the foregone. aamlKngs per participant 

are lower than the emnual estimates because of differences in length of 

i 

stay/ • ' ^ . 

r ' > • 

V In-program wage3 are a* cost to the nonpeurticipants who -are taxed 

to pay for them; ^foregone output is* a cost, to society; emd participants ' 

gain the difference between their Supported Work earnings and what thpy 

would have eatoied in its absence. As TaO^le 11.4 shows, participants 



gain 'substantially in eaumed income as a result of beinig in Supported 
* ^ Work. The difference between the avei. program ear^xings plus fringe 
.benefits of paurticipants and their foregone earnings is substantial, 
ranging from about $4,000 per p^rticipanto for AFDC tp about $2v 5.00 'for 
the. other three groups. (Participants ^re,* of course #^ not made better 
*-'vpff by »the- full amount of this eaumed ihcome becavise -they lose -we If are 
payments and pay taoces.) . A ' 

■- -.^ .. . • , • • ■ ' - 

J £• UNMEASURED COSTS ^AND INCREASED C5JILD CARE COSTS 

By limiting the estimate of the sociaU. cost of partidipant labor - 
to the foregone output from paid work, the^ analysis ignores foregone 
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i«is\m ind nonwirket' production, such as child care, and household work. 

FbcuBing on market output is customary in benefit-cost analysis and, to 

, » ' ' ' .i ^* • 

. th# extent that the control group wants to work but cannot find jobs, 

the ^ue of the leisiire^::td^ nay be quite; low or even negative. .One 

particuliurly in5>ortant output that is 'often not paid for is child care. 

For the A^pC target group, ^the increased cost of child care is potentially 

large, so" the increase' in this work-related expense has been measured. 

The^;differential between experimeiiljals and controls in child 

care costs is 'estimate'd on the basis of 'interview and other data. The 

cost to participants is their out-of-pocket costs less any reimbursements , 

- " ' 1/ ' ^ 

frSm welfare agencies.-^ The c6sts'of "^ree" day care are bozne entirelir 

by npnparticipants— as part of welfare programs.—'^ 

The increase in the cost of ' child care as result ' of Supported 

Work was relatively small. This is nok s\uj)rising since (k) one ^ligi- 

bility criterion for the AFDC group was that all children be -an least six 

years old (thu^ presumably in school much of the time) .and (b) roost child ^ 

.cara wais inexpensive "informal" care — care in the homes of babysitters pr 

relatives—rather than "formal" care — caure in organized centers. This 

reliance on informal care reduced 'the cost. ' The difference in total day care 

costs between AFDC experiroentals and controls during the entire 27-month" 



1/ ' . ' • 

-'Estimates were based on differentials between the .experimental 
and control groups* in the xise of child care reported in peurticipant 
interviews.-. The participauit interview data, which are used to estimate 
nearly all benefits/ are described in Chapter- III. 

2/ • ' . 

These^ estimates .were not available directly from interview 

data and had to" be. inputed as the numbers of months children were in . 

formal ,day cafe (froV interviews) txaias the national average cost of 

fotmal day care (from publi'shed data), JLess emy payments by paorfcicipants 

for formal day care (betsed on"" interviews) . See Thornton 'Snd Long 

(fprthcoming) for details. ' . 



period when they were ■ iiiteryiewed was edbout $360, nearly half of whi^l> 
was" bome by participanfes* The differential in chi^d care costs declined 
over/the period as a resiilt of a decline in the difference in employment 
between tfje two groups, vuitil it was only eibout $30^iri the 19-to-27-month 
period. A rough estimate of the cdiild caure cost differential correspond- 
ing^ to the period when APDC participants were enrolled in Supported Work 
is*'$26o. ■ ^ 

* These costs represent only the resource cost of increased child 

' ■ * ■ ■ • . V 

care. They do not include possible developirient£OL coslis Becciuse the\^ 
children are no6 caredy.jgpr by; their own parents. While little is known 
^ about the effects of nonparentsd child caure on child development,'' this is 
another potential cost of putting people, especially AFDC mothers, to work. 
For the AFDS-$2:oup served by Supported: Work, these unmeasured costs may 
be relatively small because the age 'of the children ensures that child 
ca^re will be limited to the period after school and vacations. If 
Supported Work were expemded and extended to parents with younger 
children, however, the cos€ of care of children by nonparents could 
become far more significant. 

In addition to child care, paurticipants face, increases in other 
work-related expenses— such as increased transportation, clothinig, and 
meal costs. These- aure* costs both to participants amd to society. They 

r 

au:e. probably small conpaured to other social costs, but they could be 
large enough from participants* perspective to affect the work decision 
of r^me. Whatever the case, liowever, no attempt has been maLde to 
measure them' here.' * * ' 



P; SUMBiARY OP ESTIMATES ' 

Like all cx^nponents of the analysis, as we have stressed/ costs 
can be viewed from the social,^ participant, and nonparticipant perspectives 
One additionea perspective is sqxnetixaes of interest for costs-'-that of 
Supported Work's own biidget. Although it is a narrower perspective" than 
even the nonpartidipant perspective, the Supported Work budget does 
determine the direct gevemment expenditures required to fund Supported 
Work. That the same goverixment incurs :pi<iirect costs (for exanqple, 
increased child care subsidies) and gains indirect benefits (for exaxtple, 
reduced welfare payments) sixthly underscores the narrowness of this per-- 
sgective and suggests^ caution in interpreting the estinpt^ from the 
budget perspective* Nonetheless, the Supported Work budget is often 
viewed as the price tag for the program. If for no other reason, it is 
iiseful for comparison with the social cost estimates. 

Most, but not all, of the costs to nonparticipants are part of 
the Supported Work budget. Project,'^^ overhead, central administrative,-^ 
and program wage costs all appear in the Supported Work budget, but in- 
creased child caure does not*^^ Much in-program output, as noted above. 



^ T^A small part of project cost does not appear in the Supported 
Work. budget. Although this amount is small enough to ignore 'for Supported 
Work itself, it might not be. so small for otiier programs, so care should 
be taken in making comparisons across prograuns* 

2/ 

r .Although central administrative costs appeeu: in the Supported 
Work budget in the case of this demonstration, since it is run by MDRC 
instead of the federal government, they might ribt appear in .its budget 
under an alternative orgmiizatiorial structtire. Again, care is reqxiired 
in cpn^pauriLng with other programs. 

3/ . 

— Agdxn*undar a different program design, child care might be 
provided as. a supportive service and, hence, appear as a program budget 
outlay* 
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is sol'd to customers to raise revenue, whiclv .becomes paict of the local. 

^ rv . . 

matching funds and partially offsets budget outlays, Tl?^ difference 

between the estimated value of. output and the rfevenue received for the 

ft - ' 

output is a benefit to Supportejd Work's customers (who au:e also non- 
participants) . 

Table II.5 sumnarizes the estimates of costs and veULue of output 
per^yeeu: of service, by perspective. Separate estimates of participant 
labor TOst by. target groiap were possible because^ they' were biased On 
individual interviews, data from which can be aggregated by target group. 
(These estimates are shown in the table*) For the other components of 
cost and for value of output/ s^peurate estimat^s^ by target group are much 
more difficult to nake because the data are collected by prpject or site~ 
which have varying mixtures of tetrget groxips — rather than by individual. 
San5)le sizes, in fact, turned out to be inadequate for making reliable 
estimates by target group (see Kemper and Long, forthcoming) • Conse- 
quently, we have used the average for all target groups. ; - 

As the table shows, total Supported Work budget outla^i:?^ ./ere 
about $14,000 per yeau: of service, about a quarter of which ^ero offset 
by revenue from the sale of project output. The net Supported Work budget 
expenditures were/ thare fore, estimatjad to be about $10,000 to $11,000 per 
year of service. 

Net cost (that is, cost minus value of output) is substantially 
lower from the social p^erspective because the foregone output of partici- 
pants was below their program wages and because theXvalue of in-program 
output was estimated to be above the revenue received for it. Gross 
social cost averaged , ak>ut $9,000 per year of service; about two-thirds 



SUMMARY OP COSTS AND VhUSE OF IN-PROGRAM OUTPUT PER YEAR OF SERVICE, BY ACCOUNTING PERSPECTIVE 



ro 

09 



J^roject Cost 
Overhead Cost 

Central Administrative Ccst 

Participant Labor Cost 
AFDC 

Ex-addicts 

Exrof fenders ^. 
Youth 

Increased child Care Cost 
(AFDC only) 

Total Cost^ 
AFDC 

Ex-addicts 

Ex-offenders 

Youth 

V^lue of In-Prog ram Output 

\ Cost less Value of Output 
AFDC 

Ex-addicts 
Ex-offenders 
Youth 



Social. 



3^,797 
3,014 

365 



1,175 
2,188 
2,232- 
1,734 



271 



8,622 
9,364 
9,480 
8,910 



-6,018 



2,604 
3,346 
3,390 
2,892 



a/ 

k mmmmmn , ^ Incrsased cost of child 



(dolllbrs) 



Participant 



-5,298 
-4 , 582 
-5,042 
-4 , 570 



115 



-5,183 
-4,582 
-5,042 
-4,570 



-5,183 
-4,582 
-5,042 
-4., 570 



Supportt^d Work 
Budget 



Nonparticipant 



Outside Supported 
Work Budget 



3>797 
3,014 
365 



6,473 
6,770 
7,274 
6,304 



'13,649 
13,946 
14,450 ^ 
13,48(3^ 

-3,298 



10,351 
10,648, 
11,152 
10,182 



0 
0 
0 



0 
0 
0 
0 



156 



15> 
•0 
0. 
-0 



-2,720 



-2,564 
-2,720 
-2,720 
-2,720 
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care is included in the total cost of the /AFDC group only. 



^ot tid9^^^\^ by the estimated value of output so 'that net social 

cpit per year of service was about $3,000 per year of service. As discussed 
aibove"', ,particii?ants enjoy a substantial benefit (which appears as. a 
:negativ'^ cost in the participant column of Table II. 5) a's a result of 
their, increased earned incproes* finally # some customers benefit (Erectly . 
£rom :SvCTorted Wbrk to the extent that tHey pay less than the alternative 
si:^piler*s, price for project output, v . 

!The ayerage cost^ pe^ participant was, again lower than the annual 
cost because participants, average less than one year of enrollment. 
Tajile il.6 shows that .ttie grossrsociar cost per participant was about 
$6,^*500 for the APDC group and around $5^,000 fof the other three groups/ 
Net of the estimated value of output, social costs were thus. between 
$1,600 and $2,000 per participant. These costs can be viewed as an 
investment jnade dtaring the period of enrollment to' earn other benefits 
both during and after the program. 

G.* SENSITIVITY OF ESTIMATES TO ASSUJpTlQNS 

While we believe the benchmark estima^tes are reasonable, a number 

of. it^rtant assumptions had to be made in estimating them. Three areas 

of uncertainty in particular "suxxojinded the estimates: (1) the exclusidn 
•of start-up costs, (2) the estimates of value of output (and the closely 

associated project costs) , and (3) the estimates of central administrative 

costs* In this section, we shbw the effect of using some alternative 

•estimates ' of these cost components on net cost. 

All costs (except participant ^labor and child care costs \ and • 

value of output were e'stimated per year of service and then, multiplied 
' by the' average length of stay for each target grpup to obtain the per 

■ ■ - • ' 
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COST AND VALOE OP IN-PROGRAM OOTPOT. PER PARTICIPANT FROm' SOCIAL PERSPECTIVE, 

■ BY TAWSET GPOUp; . 

(dollari) . ' ♦ 



AFDC Ex-addicts Ex-of fender^ Youth 



Pro j act "cost 

* - -/ * 
Overhead Cost 


2,845 


2,117. 


, 1,872 


.2,136 


2,260 


1,681 


1,487 


1,697 


Central/Administrative Cost 

Foregone Earnings Plus 
Fringe Benefits 

Increased Child Care Cost 


270 

879 
204 


201 

1^-219 
^ 0 


178 

1,100 
0 


'203 

974 

P 


Total Cost 


6,458 


5,218 


. 4,637 • 


5^010 


Value of In-Program Output 


4,520 


3,363 


2,973 


3,394 


Cost less Value of Output 


1,938 

* 


1,855' 


■ 1,664 


l,6i^ 



NOTE: Project, overhead, and central . administrative cost, and value of out- 
ymtf. cony.erted,-.£rom ::y^ of service, bases to a per participant 
Wi^iplyi?i9 .tAe n months, participants were enrolieci 

in Supported^ WorkVduf iig^ 9fmbnth period by the per month esti- 
' mates (,tJie;,aiuiuaiy<»it by. il2) and discounting estimates 

to thf -midpoint; p^^^ a 5- percent annual rate. 

Foregone earniijgs estiimt^ obtain^ from. Table .11.4. For' AFDC 

the child care c^^^^^ for the period of enrollment 6b- 

t^ined by multiplying this estimite for each 9-fflonth period by the 
proportion of time spent enrolled,, sumraiftg and discounting. 
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^rrf \ 'pai^cipMt •sti^ . Since the APDC target group had the longest 
' . length, of stay ^ their per^part^cipant estixnates will be most sensitive 

to changing the estimates of cost and value of output per year of service. 
^ The other target gro\j^8 had average lengths of stay roughly equal to each 
othetr, so the sensitivity of results to changes in annual cost and value 
of out^uti estimates will be similar across these three groups. Although 
the discussion, is limited to the social perspective, identical -Ranges 
will apply to the nonfwirticipant perspecti^ as weli.^ (The participant 
perspective is unaffected by the changes considered here because 
participants neither pay program costs nor receive project'output.) 

Start*"up costs > Estimated start-up costs have been excluded from 
the benchmark estimates on the assisnption that they are incurred as part 
of the process of establishing an operating program and that the resources 
used in this process do not have a major effect on program benefits. 
Table Hi 7 presents estimates of cost and v&lue of output that are based • 
on averages for all three years amd do, therefore, include start-up costs. 



The numbers in parentheses are t^e changes from the benchmark estimates — 
that is, the implicit estimate of stkartrup costs. 

Value of in-program' output is ilightly lower when the start-up 
period is included,^ aind costs are substantially higher. If start-up 
costs axe included in ali coirponehts, the total cost net of value of 
output increases by about $1,700 per year of service. On a per partici- 
pant basis, the AFDC net cost increases by about $1,200 and the other 



^The value of output and project cost estimates in Table 11.7 
were based on the sanple including the first year observations (but 
excluding the outlier) . 
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TABUS n.7 

SOCIAL COSTS AHD VALUB OP IN-PRDGRAN OUTPUT WHEN START-UP COSTS ARE INCLUDED, BY TARGET GROUP 



ro 



Cost 


Per Year 

of Service 


AFOC 


/ 


c*x— ijtr r eilue r s 


• 

Youth. ^ 


• ^ r 

Project Cost 


. 4,113 


,( +316) 


3,088( 


+243) 




^,UJ^(+XcO; 


2, 319 (+183) 


Ovttrhead Cost 


3,896 


( +882) 


2,926( 


+666) 


2, 177 (+496) 


l,925{+438) 


2,197.'{+500) 


Ceatral Adninlstratlver Cpst 


786 


( +421) 


594 ( 


+296) 


J 

442 (+241) 


391 (+213) 


446 (+243) 


Participant Labq^r 


1,799 


( 0)2/ 


879 ( 


0) 


1,219( 0) 


1,1C0( 0) 


974 ( 0) 

• 


Total Cos^ 


10,594 


(+1,619) . 


7,691 (+1.205)^/ 


6,135(+917) 


ft 

5,448(+811) 


5,936 (+926) 


Value of In-Program butjiut 


5,966 


( -52) 


4,475( 


-45) 


3,329( -34) 


2,944 ( w29) 


3,360( -34) 


Cost Less Value of Output 


4,628 


(+1,567) 


3,21'S(+1|312) ^ 


2, 806 (+951) 


2,504 (+843.) 


2,576 (+959) 



-er|c 



NOTE: Nupfcers in parentheses show the amount and direction of chfinge from the benchmark estimates given in Tables 
II. 5 and 11,6 that results from the inclusion of sta;.t-up costs. - > 

- S/xhls is an average of all four target groups. 

, -/This includes $204 of increased child care q.ost, which was only roeaisured fpr the APDC group and Is 
unaffected by these assumptions. 
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-target groups by about $800* ThuSr including start-up costsf increases 
the .estimates of net cost by just 'over a third of the benchmark. 

As, discussed ataove, the case for including all- stsurt-up costs is 
•not strong, but an arguanent can be made that st2ai:-up costs should be - 
auaortized over the life of the St;q?ported Work program and included for some 
purposes. . If start-up costs incurred in the program* s first three years 
are amortized over 20 yeaurs at a 5 percent discount . rate, total program - 
costs increase by less than $100 per year of service — a small relative 
increase. , , ^ 

P roject cost and vadue of output s ^ discussed above, the 
estimates of value of in-pxograun output and project costs were based 
perforce on a rather small sai!j>le of case studies. Since the^e is quite 
a lot of variance acros;5 projects in the restil.:s, the estimates o^*vid.ue 
of in-prograun output are subject to a good deal of uncertainty. 
Specifically, the estimates of vadue of output (net of project cost) 
depend on the sample exclusions amd reweightings used in calculating the 
sanple average. In addition, the benchmark assumption that the value of* 
output to sopiety is equal to the auaount an alternative supplier would 

•* chairge to produce the same -output is a debatable one, although' it yields 
a reasonable upper bound estin^te. As noted .eaurlier, the revenue actually 
padd to Supported Work for project output is a r^iasonable lower bound 
estimate of society's willingness to pay for the output. The sensitivity 
of the benchmark estimates to each of .these assumptions is discussed in 
turn.- *^ 

If the estimates had been based on the. full sample without re- 
weighting, cost net of value of output per year of service would have 



0 

b«l«n $1,485 high«r~an increase of about half. While we believe the 

exclusions and rewei^htings are reasonable, a different approach ndght: 

h^e been taken to. making a benchmark .'estimate — that is, to rel]^ 'solely 

on\the random sample (including the outlier) on the grounds thit, although 

small, it wa:s designed to provide unbiased estimates for the uni'vferse of 

project hours worked, under this approach, net cost would have be'^n S552 

• ^ 
higher than the benchmark, an increase of about a fifth. Finally,' if ^ 

revenue had been used as the estimate .of value of outiput instead of the 

alternativ* supplier's price,"" then* net cost would haye^en $2,720 higher, 

nearly double the benchmark estimates of net cost. The net .cost estimates 

are; thus, qxiite sensitive to the method, of estimatfJig value of output 

and project 'cost. 

• ' % 

Centrfl administrative costis . The estimate of central adminis- 

trativ^ costs required assumptions about the magnitude of evaluation 

< ♦ \ 

research cost and startup costs. If we -use the estimated federal central 
administrative costs of the Job Corps and CETA-PSEi programs, the overall 
estimates of social and nonparticipant cost i^ef participant clianges y|fry 
little~from .about $10C^ tj§ $200 in eith«fr direction. Thus results aye 
relatively .ins^sitive to changes in the estimates of central adminis- y^*"^ 
trative costs. " 's % 



I - 
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■ " " ■ benefits " , ' . v > 

• In the- previous chapter we have eKaunined those elements of the 

accounting -framework that dirtctiy. concern* program operation: . program. 

cost .and thet value of £i-program output. -In this chapter we consider the 

• *. 

r*aaining elements of the accounting framework-*-the benefits that arise as 
' .participant* change their bejhayior as a result of Supported V- rk. Six 
behavioral categories are' examined; (1) the* increase in output produced 

' by participantis after they^leave the program; . (2) the corresponding . 
changes in tax payments; (3) corresponding changes in transfer program 
utilization; (4) benefits arising from reduced cripiinal activity among \ 
participants; (5) benefits resulting from decreases in drug and alcohol 

^ bse; and (6) net resource 3avings from decreases in the participants' use 
of -alternative education and en^loyment programs diiring and possibly after 
participation in Supported Wbrk. Each of these is discussed in-turp after 
a brief description of the data base underlying the results. 

A. DATA UNDERLYING THE BE?1AVI0RAL EFFECTfe ESTIMATES 

All' estimates of ^the -^fects of Supported Work are b^sed on ^ data 
collected in periodic interviews with ^xperimentals and controls. Every- 
one. included in the sample analyzed in this report (and in the four target 
^group, outcome reports) was given a baseline'^nterview at the time of ' , 
enrollment.-^ For 'the main sample ^this was followed by two follow-up 



^Not everyone in^the origineU. sactple received all the interviews 
for which they were eligible- Those persons .who missed baseline^inter- 
viewt were dtopped from the analysis; * . 



^dntefviews, pne adsiinistered nine months after enrollment emd one 18 . 

nonths after enrollident. A subsasiple waf 'then administered one additional 

interview 27 months after enrollment. A smaller subsasple was administered^ 

yet anqther follow-up interview'36 months after enrollment. The saxrple . 

sizes of these three^^oups are given in T^le III.l. Data from these 

thr^ee interview groups form the basis, of the evaluation. 

As can be seen from Table IIX*1/ the san^le sizes of those who 

were followed for the fiill 36 months (the 36-roohth cohort/ are s^ll~ 

and for the AFDC group zero /'For this reason, and a^so because the SB-- 

month cohort appears to' have behaved ^somewhat differently from the other 

cohorts throughout the analysis 'period, the estimates derived for the 

period . fter month 27 must be interpreted with care. The basic benefit . 

resxilts, therefore, are pjjesentgd for months 1-27. The results for tha 

later period are discussed in the target group ^hapters when the issue of 

extrapolation to future periods is addressed. . . * V 

^ < ' - — * 

Two othet^asic features of the methodology used 'in the benefit- 

* 

cost analysis should bfe mentioned '^bef ore turning .to the results. First, 
effects are estimated as differences- in meam values between controls and 
e:q>erimentals (or vice versa) for some benefits. .The second common 
feature -is that in order to adjust for inflation over the period of the 
demonstration, .1974 to 1978, • all values (as was true for the costs emd 
value of output) 5u:e expressed in terms of fourth quarter 1976 dollars — . 
the approximate midpoint* of the evaljiation. 

B. INCREASED POST-PROGRAM OUTPUT , 

* ' ■ ^ • '■ ' ' 

A maj-'^r objective of Supported Work is to increase the output 

produced by participants after they leave the program. Such increases 



i7 \ TABLE III. 1 



NCJHBER IM SA!4PLE; BY TAKGET GROOP AND TII1E PERIOD. 



' Months sintfa 

■ anrollneht ' AFDC .-■ Ex-addicts Ex-^af fenders Youth . -Total 

_ ' •'■ \ :^ r I ' ' 77: 

' Months 1-'18^ 1,351 974 l-,479 861 4,665 

# Months / 616 885 1,011 513 3,025 



Months 28--362/ Q 311 292 153 756 



NOTE: For 3obe vatriableSf missing data nay ca^se the sample sizes tc be 
slightly 'Smaller than shown. /' 

- a/ . \ 

' The 18*month 'sample includes all who\ completed a "baseline, a 9-, 

auid an 18-month interview. - * 

b/ * * ^ 

^ -- The 27-month sample in^lu^^ all who conypleted a baseline and 

a 27-roontJi interview, whether or not they COTipleted 9- and IS-month interviews, 
c/ 

♦ * . — The 36-roonth sample includes all who completed a baseline and 
a 36-month interview, whether or not they- completed the intervening' 
interviews. 




in thm production of goods and services for the economy as a whole (i.e^^ 
increases £h gross national" product or GNP) are important potential 
benefits to society* They will also be seen, as benefits by participants 
%*b receive the increased wages corresponding to the increased production^ 
In addition, increased eoployiaent is pres^uned to affect welfare dependence, 
drug abuse, criminal aurtivity, and the use of alternative education and 
'^training programs (effects that Will be valued separately in the follow- 
ing sections) . . • ^ 

The increase in post-program output due to Supported Work is 
the difference between what expefimentals actiaally produce after leaving 
the program and what they would have produced had they not enrolled in 
Sifl?ported Work. This difference is estimated as the difference between 
the aver^ige gross condensation of experimentals (i.e., their pretax wages 
plus fringe benefits) and that of controls. This requires, first, that 
the value of. output can be estimated from eeumings. This assim^tion is 
standard in microeconomic 2ui2d.yses of this kind, but will be examined 
more, closely in the chapters that report the target group results 
(Chapters IV through VII) . It requires, second, that the gross coirpen- 
sation of controls be a good estimate o^f what experimentals v^uld have 
earned in the absence of Si:4)ported Wbrk. The design enphasis on random 
aissignment to the experimental and control groins allows us to make this 
second assun^tion. 

T2d5le III. 2 preseiits the estimates of the net increase in post-' 
program eaumings plus fringe benefits during the first 27 months following 
enrollment for the four Supported Wbrk target groups. During; months 19-27, 
when nearly all participants had left" Supported Work, the earnings increase 

2H 
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TABLE III- 2 

JNCREASED POST-PROGPAH EARNINGS PLUS FRINGE BENEFITS 

(dollars) 



Time Period 



AFPC 

' J 



Ex-addicts 



Ex-of fenders 



. Youth 



Months 1-9 



59 



-132 



129 



58 



Months 10-18 



-111 



80 



-126 



Months 19-27 . 627 



Total 

(months 1-27) 1,087 



92 



-151 



106 



315 



^5 



-3 



NOTE:' The increase in post-program earnings is estimated by the mean 

non-Support ed-Work eatrnings of experimentals minus the mean earn- 
ings of controls, all marked up by 15 percent for fringe benefits. 
For months when some experimentals vsre still enrolled in Supported 
work, mean earnings of' controls were multiplied by the mean pro- 
portion of ^the period that participant were not enrolled in 
Supported Work. 



.4ue to Supported W6rk for the AFDC target^roup was substantial— over 
$600. For e^x-addicts, ex-^ffenders^ and youth/^^hoVever, earnings in- 
creases were quite small, indicating that Supported Wbrk had little 

effect on their post-program fen^loyability as measured by post-program 

. 1/ ' • ^ ; * 

earnings.-^ 

C. INCKEASED TAXES PAID BY PARTICIPANTS 

. As oai^nings of experimentals. rise, so do the taxes they pay. 
Participants see this as a cost; but nonp^rticipants, who are the major 
beneficiaries of the increased taxes, see them as a benefit. From the 
perspective of society as a whole the benefits and costs to these groups 
will cancel out, so tax" payments will not enter the social benefit-cost 
ccilculations. - 

Table III. 3 presents estimates of the increased 'tax payments for ' 
each of the four target .groups • They include tax payments for federal 



— Problems arise in attempting to estimate pl;ianges in post-program 
earnings for the time periods> when many participants are still in 
Supported Work, stemming from the difficulties of making valid con^ari- 
sons between a subgroup of experimentals (those who have left the program) 
and the entire control group. This means that the estimates for months . 
1-18 are not as reliable as. those for the later period. The mirror im^^e 
of this problem was confronted in estimating foregone earnings for the 
"in-program" period. As discussed In Chapter 11^ the specific procedure 
used was to estimate, for each " 3-month period, the .average proportion of 
the three months tHat 9:q)erimeritals we-e enrolled in Supported Work. That 
proportion of the control group earnings was used as the estimate for 
foregone esuoiings of participants, while enrolled. The remainder of 
control group earnings Ws assumed to be the amount that those experi- 
mentals, who left the progrcun would have earned; it was subtracted * from 
their non-Supported-Work earnings to^ obtain the estimate of the change 
in pq^t-program earnings for that tim% period. Any errors in the esti- 
mates of post-program earnings gains resulting from this procedure for 
months 1-18 will be offset by corresponding errors in the estimates of 
foregone earnings. The net present value estimates are therefore un- 
affected by this procedure. 
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TABIJb/iI1*3* 
INCREASED TAX PAYMENTS PER PARTICIPANT 
(dollars) 



\7- 



Time Period 



AFOC Ex-addicts 



Ex-offenders 



Youth 



Months 1-9 



343 



233 



408 



265 



Months' 10-18 



139 



27 



^ 95 



28 



Months. 19-27 



83 



33 



50 



Total (Months 1-27) 



565 . 



293 



553 



301 



NOTE: These figures have been discounted to the midpoint of the first 
9-month period at a 5 percent annual rate. ''• 



!:eric 



;i 29/346 



axid stat« Ihcom taxes, social security payroll taxes, and sales and 
excise taxes. Taxes have been Isgputed on the basis of statutory tax 
incidence (by state of r^dence where appropriate) and average con- 
sunqption patterns. They take into'^account not only total income but also 
household size, relevisnt tax ratis and regulations, and ziational data on 
Hi^AMehold e^^enditxures by income class. 



The total increase in taxes paid by participants was substantially 
larger for months 1-9 than for the later periods. This follows the pattern 
of participart incomes, which were highest dCiring the first period when 
most participants in. the demnstration were earning program wages. In 
later periods income fell as participants lefl^ the demonstration*. T£uces 
paid by AFOC participants increased the most; we estimate that they' paid 
a total of $565 per participauxt more than AFDC pontrols over the whole 
27-month period. Ex-offenders had the second largest increase, $553 per 
^)urtdcipant, whi^e ex-addicts *2uid youth had similar increases (around 
$300) . Most of these tax increases were due to increased payments for 
the federal income tax and the social security payroll tax. 

D. BEOUCEO USE OF TBANSFER PROGRAMS 

The benefit-cost analysis divided the benefits from reduced use 
of transfer programs by participamts into two coiqponents: the reductions 
in the dollar value of transfer payments to pairticipants and the reduc- 
tion in the administrative costs of tremsfer progreuns. Uine types of 
treuisfer programs were assesse^V^^^^se included five programs providing 
direct cash 'transfers— Aid to Families with Dependent Children (AFDC) , 
general assistance (GA) , unen^loyment condensation, Social Security, and 



Su^piwiMt^ Sectufity Income (SSI); three programs providing in-kind 

transfers^^ stwqps, public housing, and Medicaid; . and othor welfare/ 

• *•>'* ' * ' * > . 

4 category which includes cash transfers from miscellemeous small programs 

^ . ' ' ~* ^ 

pl.w tfh6se cases where individuals reported receiving cash tr& isfers 

(probably from AFDC or general assistance) but were unable to s y'frofa 

which specific program the^payxoent^ camev 



1. RsducedlTfarfsfer Payments < ^ T 

For participants, the net reduction in average ^transfer paymc^nts 
represented one of the major costs of participating in Suppprted Wbrk; 
In fact, ^ for the AFDC target group it was (on average) the largest cost, 
even leirger^ than the foregone eetrnings. For the other target groups, 
the reductions in treuisfers were smaller amd represented^ less of a cost 
to them* For nonparticipants, the reductions represented a benefit..dn 
the form of a' lower tax bill* From the social perspective, the gains anob 
losses brought aU^out by the change in transfers again cancel out. Thus, 
as with tauces pedd, the changes in transfers are relevant for evaluating 
the distributional consequences of Supported Work but x^t its sociad 
efficifmcy. 

Self-reports of transfer payments received by respondents ^ 
(obtained from the- inteirviews) were us^d to estimate the changes in 
payments to paurticipants from the cash transfer prQgrauns. ^To estimate 
changes in in-kind transfer programs, and chamges in other household 
members* use of cash welfare progreuns, however, it was necessaury to use 
imputation procedures* These imputation procedures involved estimating 
changes in program utilization obtained from the interviews . and valuing 



these changes using published data regaurdlng average benefit amounts.-^ 

Where possible, account was taken of znajor household characteristics 
' f 

affectxng program eligibility and payments levels. 

• The. estimated reductions in the average transfer payments' 
received by participants are shown in Table IIi:4. As'^mentionedV they 
indicate .that aU.1 target groups had an overall .reduction in transfer 
payments. The differences in the magnitude of these * iuction^ reflect 
the differences in the extent to which the vetrious teurget groups ;were 
^ligibL^ for and would have participated in the transfer programs'. The 
AFDC group had the hi^ghest initial level of tremsfer use and, corre-* 
spondingly, showed the largest reduction (over $2,600 per participant). 
The other groups had lower initial levels of use and, therefore, the 
reductions we^re smaller* The estimated reductions .^ji total transfer 
payments per participamt to the three rion-AFDC groups were $530 for ex- 
addicts, $219 for ex-offenders, and $474 for youth. 

The largest paymenti^^reductions over the period involved the cash 
transfer prograuns~AFDC, general assistance, and other welfare — although 



-^In the case of food st2uips, an estimate of the total bonus value 
(the difference between what the stamps were worth and *what the household 
paid for them) was made on the basis of self-reports of the amount re- 
ceived. For those respondents who reported receiving food stamps but 
could not specify the euabunt, an estimate was made based on data on months 
receiving food stanqps, household size, and income. For public housing 
the iaputation was based on the difference between published estimates of 
average maurkeb vad.ues of the housing units and the actuetl rent paid by the 
household. The value of the Medicedd tremsfer was coitputed using re- 
ported doctor visits and hospitalizations that were covered by Medicaid 
and estimates of the national average costs of doctor .and hospital care. 
To estimate other household members' .receipt of cash tramsfers we used 
estimates ^ (based on iilterview data) ot the number of months other house-* 
hold members received payments from each progratm: These estimates were 
then multiplied by the average benefit levels of the various programs in 
order to obtain estimates of the value of the chauige in transfers. 
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TABLE m.4 








V ' . 


CONtRCL-EXPERIMEOTAL DIFPERENTIAlS IN TRANSFER PAYMENTS PER PARTICIPANT 

FOR MONTHS 1-27, 'BY TARGET GROUP 








(aollars) 












iVC 


Ex**addicts 




-offenders 


Yputh 




» 

0 




274 




102 


129 


i 


vjenerax Assistutnce vyA} 


10 


218 




120 


130 






— ^ A 

— JU 


23 




-8 


1 






1 c 


1 


• 


25 


29 




.Unemploynjent 
Conpensatxon 


-280 


-188 




-47 


-146 




Social Security 


56 


41 




-3 


4 




Medicaid 


301 


127 




-57 


34 . 




Food Stamps 


406 


72 




•51 


31 




Public Housing Subsidy 


24 


-1 




6 


• 20 




AFDC to Other ' 
Household Members 


37 


-69 




22 


213 




' ♦ 

GA to Other 

Household Members 


3 


28 




19 


-15 




Other Welfare to 
Other Household 
Members 


1 


3 




-11 . 


45 


J. 


* » 
Total (Months 1-27) 


2,615 


530 




219 


474 



» NOTE: These figures are discounted to the midpoint of the first 9-month 
period at a 5 percent annual rate. 



the APdc qroup also lost a sxibstantial amount of Mc^dicaid and food stamps* 
Again, " the reductions v^ere greatest for the AFDC taurgat group and smaller 
for the other groups • It is interesting to note that ^ the reductions in 
AFDC au:e very similar to reductions in general assistance payments for / 
all groups except AFDC, for v^hom effects on general assistance are minimal* 
The effect of Supported Work on the receipt of AFDC and general « assistance - 
"by other househoia~5efibers was mixed, with" th"e~largest-ef f ecrts^being for 

0 . ' ■ . * 

AFDC payments to otJxer household members for the youth group* 

The remaining reductions were concentrated in the in-kind transfer 
programs — food stamps, Medicaid, and pxiblic hoxising. Changes in receipt 
of Social Security and SSI ware small and varied in magnitude and sign. 

The only major exception to the overall pattern of reduction in 
transfers received was unenployment compensation, which increased for all 
target groups. In months 1-9, experimentals had lower average unemployment 
compensation payments. However, their eii5>loyment in Supported Work during 
that period made some peurticipants eligible for such condensation in later 
periods (regular Unen^loyment Insurance in New York and Special Unemploy- 
ment Assistance in the other sites )^ and caused average unemployment 
coii?>ehsation to rise in the later periods-for_allJtarget groups. 

2. Transfer Program Administrative Costs 

While reductions in transfer payments do not enter the social 
benefit-cost calculation, the associated changes in transfer program 

administrative costs do. Any effect of Supported Work on resource use must 

I 

be included in the aacounting from the social perspective, and any change 

1 

in the anount of resources needed to run the transfer programs is included 
in this category. 



For each the cash transfer programs and also for food, stands, 
the average change .In administrative coiit per participant was confuted 
by mltiplying the average change in the number of months participants 
received transfers by the average administrisitive cb^t per case month. 
The data bh transfer program use came from self-reports gathered In the 
interviews # while the average cost data were ^obtained from federal 
government budget data. . ' ' ; 

In the. case, of pxablic housing^ th6 same procedure, was followed 
with one exception. Estimates of average administrative costs were 
obtained from a study of the housing assist2mce supply experiment (Lowry, 
1978). This procedure was followed because it^was necessary to use.aux 
estimate of averag administrative costs that included only the costs of 
providing the tramsfer, not^ the costs of managing the public housing 
units (which are included in the value of the piiblic housing tramsfers 
presented in Table III. 4) . 

The administrative costs of Jledicaid were measured using Medicaid 
budget data to estimate the ratio of total administrative costs to total 
benefit payments, which was then multiplied by the estimated Medicaid 
transfers received by sample members. 

The pattern of the estimated administrative cos€ savings due to 
the reductions in transfer program peurticipation among supported workers 
is shown in Table III. 5. The AFDC target group 'generated the largest 
reduction in transfer program administrative Qost ($137)/ followed by 
'youth ($78), GX-addicts ($47)-, and ex-offenders ($41). ^ 
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COIiri»L«EXPEIUMENTM^ DIFPERENTZALS IN if)MZKSTItATIVE COSTS OP 
TBANSFER PROGKAMS PE» PAl^CZPAMT FOR MONTHS BY TARGET GROUP ^ 


V 






• 


(dollars) 


* 




; 






AFDC 


Ex'addicts 


Ex**offenders 


Youth 


v" 


< t> > 


AFDC 


102-; 


. ■ - 23 


11 


12 • 






Giintrai Assistance (GA) 


0 


•29 


16* 


16 






SSI 


0 


2 


-.2 


2 






Ottisr 'Welfare 


1 


-1 .» • 


5 


5* 






Conqpensation 


. -35' 


* 

-17 


-4 


-14 




( 


Social Sftcuritv 


1 


1 


0 


0 

1 




t 


Medicaid 


14 


6 

i 


-3 


1 






Pood Stamps, 


42 


7 


5 


8 






Public Housing Subsidy 


• 7 


r 


. 10 


. 20 


I 


i 


AFOC to Other 

Household Members 


% 


-8 


3- 


1 

25 


~\ 


1 


GA to Other 

Household Mcunbers 


0 


3 


2 

V 


^2 




• 


Other ^Welfare to 
Other \ Household 
Members 


0 


0 

• 


• 

-1 


. 5 


] 




Total' (Months 1-27) 


137 


'47 " '41 ' , 


78 






-NOTE^_jThes(B figures are discounted to the midpoint of the first 9-«onth 
, per iod"~aLt^a-5~per cent ^annual rate. 






{ 




« 

* 








ERIC 
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E. REDUCED CRIMINAL ACTIVITY ' ^ 

- / * . ' ' ^ . . 

^ The methodology .used to value th^ effect of Supported Work on 

participant criminal activity takes the'estimaCted reduc-iors in jiinie.-and 

• • 

amltiplies them by the estimated social value of 9uch reductions.-^ This 
procedure is don^for several different types of crime so that*changes in 
both the overall level and the mix of criminal activity, can be assisissed. 
The estimates of crime reductions *au:e based' on estjjnates o^ the control-, 
experimental differences in avcjrage number of atrrests* The estimates pf ' 
the social ^value of crime redarbions- are based on the value of the re- •) 
sources society saves when crimes are not comcSitted — specifically, the 
resources saved from reduced costs of*- the criminal justice system (police, 
prosecution, courts, arid corrections)/ reduced personal injury and property 
damage, and reduced stolen property. Society's demand for crime reduction 
(i.e., its willingness to pay) is not directly measured by this procedure, 
em issue discussed later in this section. ' 

The resource savings from reduced personal injui^, property 
da m age, auid crimined. justice system costs will be benefits to society and ' 
to n^nparticipants, but will not affect participants.-^ The reduced value 
of stolen ''pzroperty will also be a benefit to nonpsurticipants and society, 

— "^This procedure assumes that other criminals do not change their 
behavior in response to **Jie reduction or crime among prograun peurticipants 
(they do not "replace** paurt:icipants in the criminal activities that 
paurticipants forego) . That is, the reduction in criminal activity among 
paurticipauits is asstuued not to make it significantly more profitable, for 
other person? to enter into illegal activities and replace the^ participants 

— Because some paurticipants would be expected to be Victims of 
-.cr^ime^r^^ome of - the reduction in victims' losses should be counted .as a %i 
benefit to paxticipants^ This gadLn is, likely to be very small, however, 
because Relative to total p6pulation-the.-^nuntoer of participants is small. ' 
The entire ^savings is therefore treated, for amatlytical purposes, as a ^* 
gain to^ nonparticipamts; 

305' . . - . 



but less so to society to the extent that gains to nonparticipants are 
offset by losses *to the paurticipants* who no longer. receive the stolen 
property. Thus# the social benefit will consist of the difference between 
the>nonpa3rticipant benefit and. the cost to participants. This difference , 
is due primarily to fencing costs, damage to the stolen property, and the 
16ss in value because stolen property does not carry a legal title. 

1. Measuring Criminal Activity ^ 

The first step in valuing the reduction, in criminal activity is 
1/ 

%o measure that reduction.p However, it is difficult to obtain accurate 
measxirps o*f an individual's criminal activity because people engaged in 
such' activity- have an incentive to hide their actions* To get 2a:ound,this 
problem we used self-reports of arrests as'^he basis of our measure of 
criminal •activity.—'^ Arrests are typically well-defined events, so the * 
interview respondents should have a clear understanding of what they were 
being asked to report. Al^, off4cial records are kept of arrests so that 



^ Criminal activity ^interview question^ were not asked of rtenibers 
-of the AFDC target group because of a prior assumption that there would 
be negligible crime-related effects associated! with the AFDC group. ' As 
a result, ofily the ex-addicts, ^x-of fenders, arid youth target groups are 
included- in the benefit-c^et crxme analysis. 

2/ ' * . . 

-^'One.altcirnative proxy measure that was not used was convictions 

for crimes. Thi^ measure would reduce the problems associated with arrests 
of individuals for crimes they did n&t commit. However, it* has other 
serious shortcomings. Because of plea.baa^gaining and problems witti evi- 
dence, .the charge on which a person is convicted may not reflect the 
seriousness of the crime actually committed. More importsu^^ly, l^ecause 
the evaluation's observation period is finite! the use of judicial outcomes 
(such as convictioiO to meas^ire short- run changes' in criminal activity 
may fail to capture a program'* s effect on the more serious crimes because 
arrests for. these crimes often take, a long time to adjudicate fully. 
•Moreover, so long as the ratio of 'convictions to eurrests is 'not changed 
oy participation in Supported Work, both measures will.gi^e equally 
good measures of crime benefits. • ' . 



verification studies cam be made, and tlieir results used to adjust for 
'Underreporting* Such a. verification study wets conducted for a subsait{)le 
ot experiaentals amd controls at the Haurtford, Oaklauid, and San Francisco ^ 
sites (Schorer Maynard, Piliavin, 1979), It, found evidence of substantial 
underreporting ,by e3q)eriinentals and controls, but essentially ,no signifi- 
cant difference, in the extent of underreporting between the two groups. 
The estimate of the ratio of officially r.ecorded aurrests tp self-reported 
arrests derived from this study "is approximately 1.7; The estimate of 
control-e:4)erixB^taCL arrest differentials is, therefore, multiplied by 
tjiis ratio so that the estimated benefit is based on corrected estimates 
of the arrest differentials.^^ 

We also <?orrected for the fact that many crimes do not result^ in 
aurrests. This was done by 'using data from victimization studies, where 
appropriate, to adjust the estimates of social cost per criminal , incident 
to a per aurrest^asis. The adjustment involves multiplying the per- 
incident, estimates by the ratio of criminal incidents to. aurrests for each 
of the eight aurrest categories. The result will be an accurate estimate 
of 'the effects of Supported Work on criminal activity as long as the -true 
ratio of incidents to eurrests is relatively constamt and independent of 
paurticipation in Siy?ported Work. ' ^ 

The interview data were aggregated into eight crime categories — 
murder and felonious assault, robbery, burglary, larceny and motor vehicle 
tHeft, drug law violations ^ other personal crimes, othsr miscellaneous 



—'^The effect of dropping the undeiyreporting correction is examined 



later ifi this section. 
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crimes, and an unspecified category for those .cases -where specific charges 

were not obtauLned. This aggregation was done on the basis of the most 

serj^us chaurge reported for each arrest, estimated on the basis of resource 

costs and measures of social concern regarding the chcorge (e.g.,* the 

Sellin4ifolfgang [1974] index) . ' ^ * , * 

The estimated arrest differentials (adjusted for underreporting) 

are reported in Tables III. 6 through III. 8. The largest effects were 

found for the ex-addict target ^rotip. 'Not only did this group appear to 

reduce its overedl level of crimirutl aAivity (con:?)ared -to what xt woul^ 

have been in the absence of Supported Work) , but it also shifted away f;:om 

the more serious crimes, paurticuiarly robbery, burglary and drug law ^ 

violations. The changes in total arrests and in the mix of crimes were ' , 

, much smaller for the ex-K5f fender cuid youth target groups, and not - 

1/ 

statxstically significant.— 

As we will see, differences in these crime results explain much 
of the difference in the final benefit-cost estimates of these three 
target groups. The large reductions in arrests for ex-addicts generated 
substantial benefits and lead us to conclude that the demonstration was 
a success for this group. For youth the eUDsence of any real crime 
benefits (in addition to the lack of post-^program eetmings effects) 
results in a negative assessment of the progratm for them. In the case 
of ex-offenders, the absence of any clesir-cut crime effects lies at the 
heart of the uncertainty regarding J Supported Work's effectiveness for • 
that group. ^ * < 



1/ 

See Pxlxavxn and Gartner (1979) and Maynard (1979) 
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TABLE III. 6 . 

CONTHDL-EXPERIMaiTAL DIFFERENTIALS IN ARRESTS PER PARTICIPANT, 
3Y" >k)ST SERIOUS CHARGE Alfo TIME PERIOD » 



EX-rADDICT SAMPLE 



> 


j-tonths . 


' Months 


Months 


Months 


• 


1-9 


10-18 


19-27 


1-27 


Murder and Felonious Assault 


-0.012 


"0*022 


-0.009 


O^OOl 




/ 9.0(^6 


0*022 


-O.OO8 . 


0 .080 


Burglary 


0.021 


^0.031 


^ 0.027 


0.079" 


Larceny, and Motor Vehicle Theft 


• -0.014 


.-0.^07 


-0.020 


-0.041 


Drug Law Violations 


d.ooo 


0.037 * 


0.043- 


0.080 


Other Personal Crimes 


• -0.002 


-0.002 


0.000 


-0.004 


Other Miscellaneous Crimes 


• -0.047^ 


0.016 


0.024 


-0.007' 


^ a/ * 
Unspecified Crimes- 


-0.009 


-0.016 


- 0.001 ^ 


-0.024 


Total Arrests 
• 


0.003 


0.103 


0.058 ' 


0,164 



a/ . ^ < 

Arrests for which chaxges were not reported are classified as 
unspecified. . ^ ^ 



0 



o ,' . 35S 

ERIC' 309 



SHELL: 10/25/79 



TABLE III. 7 

CONTROL-EXPERIMENTAL DIFFERENTIALS IN ARRESTS PER PARTICIPANT, 
BY MOST SERIOUS CHARGE AND TIME PERIOD 
» 

EX--OFFENDER SAMPLE 





Months 


Months 


Months 


Months 




1-9 


10-18 


X9-27 • 


1-27 


Murder and Felonious Assault 


-0.036 


0.608 


0.017^ 


. -0.011 


Robbery 


0.001 


0.013 


-0.019- 


-0.005 


Burglary 


0.014 


-0.021 


-0.026 


-0.033 


Larceny and Motor Vehicle Theft 


-0.010 


-0.058 


' -0.034 


-0.102 


Drug Law Violations ^ 


-0.022 


0.003 


-0.008 


. -0.027 


O^er Personal Crimes 


0.027 


- -0.012 


0.020 


• 0.035 


Other Miscellaneous Crimes • 


, 0.054. 


-0.020 


-0.002 


0.032 


a/ 










Unspecified Crimes^ 


0^024 ' 


. 0.025 


-0,114 


-0,065 



Total Arrests 



0.052 -0.082 ♦ -0.166 -0.176 



a/ 

— Arrests for .which ch^arges we^re not reported -are classified as 
unspecified. ' ' 
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TABLE III* 8 ; 


\ 




\* 


< • 


CONTROL-EXPERIMENTAL DIFFERENTIALS IN AI^STS PER PARTICIPANT, 
- BY MOST SERIOUS .CHARGE AND ' TIME PERIOD 






1 " . •' " 


YOUTH SAMPLE 




J 




? ' 


* 


Months 
1t9 


Months 

lo-is 


Months 
19-27 


Months 
1-27 




f^rder and Felonious Assault 


-0.001 


- 0.001 


i 

|-0.024 


-0.024 ' 


♦ 


Robbery . * ' 


0.018 ■ 


0.004 


0.014 


0.036 




^' Burglary ' ^ 


0.015 - 


-0.003 


0.002 


0.014 




Larceny and Motor Vehicle Theft 


-0.026 


' - -0.043 , 


0.044 


-0.025 




Drug Law Violations 


-0.021 


0.005 


-0.015 


-0.031 




Other personal Crimes ^ " 


-0.012 


.0.013 


0.018 


0.019 




Other Miscellaneous 


0.023 


-0.015 
« 


0.027 


0.035 ^ 




a/ 

Unspecified Crimes— 


-0.055 . 


0.009 ^ 


0.025 


-0.021 




TotajL ^r^ests 


-0.059 


-0.029 


0.091 


0.003. 




. . —'^Arrests for which charges were not 


reported are classified 


as 



unspecified. 
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2. Vatiuing Changes in Criminal Activity 

TO estimate the value of changes in criminal justice system costs/ 
porsoxua injury and property deonage, and stolen property^ these differences^ 
in mean nuznber of arrests per participant wers multiplied by estimates of 
tKe cost per arrest for the different types of crime. The estimates of 
cost per arrest are described in this section and the estimated values of 
the Sijpported Work crifli| benefits are discussed in the following section. 

Reduced criminal justice system costs . "The largest measured 

f 

component of the "resource savings from reduced crime is the savings^ to the 
cri m i n al justice system. The costs o^ apprehending, adjudicating/ and 

incarcerating criminals are substantial, as is shown by the estimated 

* ^ 1/ 
average costs per arrest shown in the first column of Table III.9.— 

Therefore, even relatively small reducstions in arrests can yield 

siabstantifid social benefits ^ especially for murder and felonious assault ^ 

robbery, emd burglaury. Thus, reductions in arrests for serious crimes, 

as v^as observed for ex-addicts, generate large benefits. 



1/ 

— The^ costs were derived from a study of jiistice system costs 
in Baltimore^ Maryland^ ( Lettre and Synta^ l376). This study broke down 
total system costs b^ -^ajor subsystem — ^police, detention, district court 
(for preliminary hearings and misdemeanors). Supreme Court bench (appeals 
snd felonies) , and eorrectionsr-as well as by crime type. Because the 
study also included data on the number of people* aurrested for each crime 
type^ it was possible to estimate average c^fsts per arrest 'for the dif- 
ferent crime categories. The average cost of an unspecified' arrest was. 
taken to be the weighted average cost for all arrests. While the Baltimore 
data prob2d)ly reflect the relative costs of the different arrest charges, 
they may be inaccurate for nationwide studies because they were obtained 
from^a single jurisdiction. Therefore, national cost estimates regarding 
the average cost of an arrest were used to adjust all the Baltimore 
figures. This adjustment also incorporated a factor to correct for 
inflation between 1974 (the year of the Lettre and Syntax data) and the 
fourth quarter of 1976. . ' , 
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i{; . Murder and Felonious 
Assault 

;j Robbery 

I' Burglary 

1 Ixirceny and Motor 
t Vehicle Theft 

- -CO «j 

Drug Law 

Violations 

Other. Personal 
^p«JDep^ 

Other Miscellaneous 
Crimes 



c/ 



Unspecified Crimes— 



TABLE 111*9 
AVERAGE SOCIAL COST OF CRiME PER ARREST 
(dollars) 



Criminal Justice 
System Costs 



Personal Injury and 
Property Damage Costs' 



Stolen Property 
- Resource Costs— ''^ 



4,338 
12,087 
5,895 

2,618 

2 ,,590 

756 

919 
2 , 048 



7,782 
569 



408 



94 
0 

171 



0 

479 
2,317 

1,268 



0 

348 



Total Cost . 
Per Arrest ' 



12,120 
13,135 
8,479 

4,294. 

. 2,590 

850 

919 
2.567 



-"^The drug law violations and other miscellaneous crimes categories contain primarily "victimless" crimes • This 
implies direct losses to victims are small? hence a value of zero is assumed* 

-^Stolen property social costs, estimated only for property crimes, are estimated as a fraction (65 percent) of 
the average value of property stolen per arrest. 

2/The unspecified crimes category contains arrests for which no charge wis recorded. Costs for this category ^ 
are estimated as the weighted average of the costs of the other crime categories. 
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Reduced personal injury and property damage . The second measured 
con^wnent of the benefits from reduction in crime is the resource savings 
from reductions in the amount of crime-related personal injury cuid property 
damage* Using data from the National C2:ime--Panel--^lir^^^^ emd other 

sources, we were able to obtain estimates of (1) the average value of 
property ' damage from criminal acts, (2) the average value of the medical 
care needed by victims of personal crimes, (3) the average output lost 
when victims lose time from work while they are recovering from personal . 
crimes, and (4) the average costs of the administration of insurance 
heeded to compensate victims'.-^ 

Cost estimates were again made for each crime type so that chemaes 
•in both the level and composition of criminal activity could be* valued. 
In addition, the cost estimates were adjusted to reflect the number of 
incidents per arrest for each type of crime. . Thus, the value placed on 
the different arrest types reflects the expected resource savings generated 

\ 

by a reduction in one arrest of tliat type. These values are shown in 
second column of Table III .9. 

Reduced stolen property . Estimates of ^be"^>ve^age value of 
property stolen per incident were made uslAg" a methodology similar to that 
use4 to obtain the personal inj^r^^-am property damage estimates. They 
reflect victims' self-reppaC^^of the market value of goods stolen and nC 
recovered (as. with 1;&^^ther crime victimization estimates, these were 
taken from the N^ional Crime Sur/ey data base) . The per-incident values 



^e would like to thank Wesley G. Skogan for his help in obtain- 
ing and /interpreting the necessary estimates from the victimization- 
xncideM data gathered as part of the National Crime Peinel program. 
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were' adjusted to a per arreUt basis by multiplying th-s. ratio of incidents 
to arrests for each crime type. Tljus, we were able to estimate the value 

•5 

Of the expected property loss per arrest for the property crimes— robbery , 
turglary, larceny and motor vehicle theft (with some allowance for the 
presence of these types of crimes in the unspecified arrest category) . 
The expected loss estimates are shown in the first column of Table 111-10. 

The distributional consequences generated by changes in the amount 
of property stolen by participants are more complicated than those of 
other crime-related effects. Nonpar ticipants view a reduction in stolen 
property as a benefit (because the goods are n^ longer stolen from them) , 
while participants view it as a ^ost (because they no longer receive the 
stolen goods) . However, the benefits to nonparticipants are unlikely to 
equal the cost to participants. For example, if thieves try to convert 
stolen goods into cash, they will be able to realize, on average, only 
about 35 percent of the goods' value to the victims of theft (see Drug 
Enforcement Administration, 1977) . Furthermore, as we have already 
mentioned, there may be a decline in the social value of the goods because 
(1) the goods may be damaged; (2) the thief (and whoever else ultimately 
receives the stolen property) does not have 'legal title to it; and (3) 
resources (labor and materials) are used up in fencing and related 
activities associated with selling stolen property. These factors inf>ly 
that the social cost of stolen property can be approximated by the 
differences in the value of the' goods before and after they have been 
stolen (i.e., the difference between their value to the nonparticipants 
and to the participants). The distributional iii?)licati5ns of the changes 
in stolen property are shown in Table III. 10. The final column presents 
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TABLE III. 10 






• 


VALUE OF STOLEN PROPERTY PER ARREST 






(dollars) 


« 

• 






Expected Value 
of Property 
Loss to VictiKi 


T ? " 

Expected Value 
of Property 
to Criminal 


• 

Net Social 
Loss . 


Robbery 


• 

738 


2l59 • 


479 


Burglary 


3,564 


1,247 


V ?.r317 


Larceny and Motor 
Vehicle Theft 


1,951 


683 


1,268 


Unspecified Crime^'^ 


536 


188 


♦ 



a/ ' ' .-I 

The unspecified crime category contains arrests for which no charge was 
recorded. Costs for this category are estimated as the weighted average of the 
costs of the. other crime categories. 
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the net cost per- arrest to society while the middle column presents the ^ 
*i • * 

cost per eunrest to. the thief. 

3» The Resulting Estimates ^ • • ^ * 4 

i 

The estijnated values of- the crime-related chamges generated by 

Supported Wdrk f rom ,the sociad perspective are presented in TaQDles III .11 
• / 

through 111.13; ' As was mentioned, the large reductions in arrests for • . 

ex-addicts translated into large social benefits. In particialar, the 
c • ' ' . . ' . v 

reductions in robbery and burgleury arrests combine^ with the high costs of 

these crimes lead to resource savings worth over $1,700 per participant 
' during' months 1-27. For the other crime types there was a sxaall social 
'cost (resulting from slight increases in larceny). Thus, when all crime 
types were considered we estimated that Supported ^rk induced crime' 
reductions , among ex-addi6ts that were worth $1,678 per participant 
during months 1-27. ^ ^, 

For ex-offenders, there was an estiniated increase in the social 
cost of crime of $1,C47 per participant during th^ same period. This is 
due to increases in the number of burglary and larceny arrests. Because 
this result is not statistically significant, however, although unbiased, 
it must be interpreted with caution. 

For* youth, the results mirror the fact that we found no program^ ^ 

effect oh the criminal behavior of this group. The estimated social 

<t ' 
value of the slight decrease in arrests during months 1-27 was about $100 

per participant (the reductions in robbery and burglary being offset by 

the increase in ^felonious assaults) . Again, these results are not 

statistically significant. \ 

a 317 ■ *" 
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• TABLE III. 11 

PRESEH^ VALUE OP CRIME RELATED NET fJOCIAL BENEFITS OP' SUPPORTED WORK, MONTHS 1-27 

EX-AiiDICT SAMPLE ^\ ^ 

(dollars) . • 



Criminal J Jtice 
System Benefits 



Personal Injury 
and Property . 
Damage benefits^ 



1 ^ 

Stolen Property 
Benefits?/ 



Total Discounted 
Benefit 



Murder and Pelonious 

Assault . ' 
Robbery 

Burglary , 
. • I^irceny and Motor 
Vehicle Theft* 
^^ Drug Law Violations 
^ Other Personal 
, Crimes 
Other Miscellaneous 
Crimes 



Unspecifie^i Crimes- 
Total Benefits" 



c/ 



4 

' 964 
448 

-103 
196 

-9 
-48 



1,449 



7 

'41 

-16 

0 



0 
-4. 



72 



0 


11 


38 


1,047 


176 

• 


665 


-50 


-169 


0 


196 


0 


-3 


0-^ 


-9 


-8 


-60 


156 


1,678 


percent annual 


rate. 



a/ . ' . * . 

The drug law, violations and other miscellaneous*brimes categories contain primarily "victimless'\crimes . 
This implies direct 'losses to victims* are s^mall; hence a value of zero is assumed. 

b/ • 

— Stolen property social costs, estimated only fbr property crimes, are estimated as a fraction {65 percent) 
of the" average value of property stolen p§r arrest. 

c / . • 

The unspecified crimes category contains arrests for which no charge was recorded. Costs for this 
^ «tecjory ate estimated as the weighted averaej^ of the costs of the other crime categories. , 361) 



0 TABLE III. 12 

PRESENT VALUE OF CRIME RELATED NET SOCIAL BENEFITS OF SUPPORTED WORK, MONTHS 1.-27 

EX-OFFENDER SAMPLE . « 

(dollars) 



Murder and Felonious 

Assault ^ 
Robbery 

Burgl£*ry ^ 

Larceny and Motor 
'Vehicle Theft 

Driig^Lay Violation^ 

Other Personal 
-2 ' X^rimes 
^ Oth^r Miscellaneous 



* Crimes 
Unspecified Crimes— 

Total Benefits 



Criminal Justice 
system Benefits 



Personal Injury 

and Property ^/ 
Damage Benefits"* 



Stolen Property 
Benefits-^ 



-54 
-50 
-179 

-255 
-69 

26 

^ 30 
-118 



-670 



-162 



-216 



Total Discounted 
.benefit 



-97 


0 


-151 


-2 


-2 


-54 


-16 


-70 


-265 


-40 


-124 


-419 


0 


0 


-69 


3 


0 


29 


0 


0 ^ 


30 


-10 


-20 


-148 



-1,047 



NOTE: These figures are discounted to the midpoint of the first 9-month period at a S percent annual rate. 

-^The drug law violations and other miscellaneous crijnes categories contain primarily "victimless" criTnes. 
Th/s implies direct losses to victims are small; hence a value of zero it assumed. 

. --^Stolen property social costs, estimated only for property crimes, are estimated as a fraction (65 percent) 
of the average value of property stolen per arrest. . 

-'^The unspecified crimes category contains arrests for which no charge was recorded. Costs for tfiis 
category are estimated as the weighted average of the costs of the other crime categories. 
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• * • TABLE III. 13 - • 

PRB5ENT VALUE OF CRIME RE£ftTSa NET SOCIAL BENEFITS OF /SUPPORTED WORK, MONTHS 1-27 

YOUTH SAMPLE , ^ 

(dollars) ... 



Criminal Justice^ 
System Benefits 



Murder- and Felonious 

Assault 
Robbery 
Burglary 

Larceny and Motor 
^-Vehicle Theft 
^ Drug Law Violations 
Q Other Personal 
Crimes 
Other Miscellaneous 
r , Crimes 

Unspecified Crimes-- 



Total Benefits 



Personal Injury 
and Property , 
Damage Benefits^ ^ 



Stolen Property 
BenfefitsBr - 



Total Discounted 
Benefit 



• 


-97 
421 
82 ' 


-174 
20 
7 ' 


0 
• 17 

. 32 




' -70 
-78 . 


• • 

-11 
0 


0 




• 13 

i 


2 ^. 


0 


f 


31 
-47 . 


Q 
-4 


0 
-8 




256 


-160. 


7 



-271 
458 
121 

-115 
-78 

15 

31 
-59 



102 



MOTE:. These figures are ^iscouated to the midpoint of thp"' first 9-month period at a'S percent annual rate 

a/ " . •. .... - - •. . 

The drug law violations and other miscellaneous crimes- categories contain primarily "victimless!" crimes' 
This implies direction losses to victims ^re small; hence a' value of zero is assumed. * . ' " ' 

. b/ ' ' " • • ^ ■ 

Stolen propei;ty social ^sts, estimat only for property crimes, are .estimated a^s a frac*i6a (65 percent) 
of the. average value of property stoleii per arre&t. . e i 



c/ 



i^O - The unspecified crimes. category contains arrests for which no charge was recorded. Costs olr this 373' 
ERXC*^^^°*^^ ^^^^^^^^^ ^^^^ weighted average of the cod ts of the other crime categories. . ' ; 



I The benefits to nonparticipants are the same as those for society 
/ ' . 

as a vhole, except'^ for the changes in stolen property, the distributional 
consequences of which* are shoTO* in^i^able III. 14. The nonparticipant per- 
spective shows the total value of the change in stolen property per 
participant the p2u:ticip2U)t- column refVects our assvnnption that partici- 
pants would convert stolen property into cash at a 35 percent rate, and 
the social column repeats the totals shown 'for stolen property 'in 
Tables J^^^ through III. 13* 

4. Soc^iety's Willingness ^to Pay for Reductions in Crime 

• . ^ 

Ideally, .by the same logic as was used in the value of output 
discussion, the value of crime reductions from the social perspective 
' should be measured by the amount society would be willing to pay to bring 
those reductions about rather than by the resource cost savings achieved 
(which is the method we have used) . Although eii5)?.rical estimation of 
social willingness to pay is not feasible, a brief discussion of how it 
might be measured is useful in interpreting the resource cost savings - 
estimates actually used. ^ • . 

' If pol4.tical and economic processes functioned perfectly, ^6ae 
willingness to pay (i..e". , the demand) for crxme reductions could be 
measured by the social expenditures on crime reducing activities. This 
is so because public and private decision maUcers would act so t. the 
benefits to be gained from increments in crime reduction a'::;'ci7ities would 
, equal' the cost of generating those incirements. Thus, for small changes 
in crime, thfe system cost savings brought about by crime reductions would 
measure both the resouiice savings from and the demand for the ^crime 
4^eductions. Since, in. this case, the system cost savings would equal 

\ ^ ' ' 321- V 

_ • • • . , • . - 374 
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. • . » TABLE III. 14 

BENEFITS PER PARTICIPANT OP, REDUCED STOLEN PROPERTY •• 
MOKTHS 1-27,. BY AQCOONTING PERSPECTIVE, BY TARGET GROUP 

• (dollars) 



Social 



Perspective 



Participant. 



Nonparticipant 



Ex-Addicts 



156 



• -84 



240 



Ex-Offenders 



-216 



116 



-333 



Youth 



-4 



11 



<9 



NOTE: Values are discounted tcf.the midooint of tlJ^ firsf. 9-mon^h period at "a 5 
, percent annual rate. 



wi'lXi'rwrxJess to pay, there would be no need for direct estimates of 
personjiX injviry, property damage, stolen property, or psychologicaJ cost 
.savings r because they would be captured in the revealed demand for crime « 
reduction* 

ahe procedure us^ here may-,- for this reason, be double counting 

> 

^me of the benefits of crime reductions because it includes values for 
rediictions in personal injtiry, propierty damage, and stolen property, in 
addition to the change in criminal justice- system costs* Three consider- 
actions, however, suggest +-Jiat this double counting may be at least partially 
offset by con^ensating biases- First, only part of the change in crime 
prevention costs has been measured since private .cri 3 f^ventioir activities 
have been 'ignorjfed. Second, equating willingness to pay with the marginal 
costs of crime^ prevention ma^ not hold since the technology of crime pre- 
vention is iii5)erfect].y understood*' Third, the social demand for crime 
X eduction may be expressed only iir^jerfectly. through the political and 
economic processes. 

Table III -15 shows' total crime-related benefits from the social 
^perspective as measured by*total resource cost savings .{the benchmark 
estiimate) and as loeasurad by criminal justice system cost savings alone. 
For ex-addicts,^ nonsystem costs were a relatively small part of total 

benefits so there is not much difference between estimates- For ex- 

' « « •■ 

offenders the' difference is' also modest, although bigger in percentage 

terms. ° In the case of youth i±e difference* is small but in the unexpacted 

i direction due to ;high nonsystem <po'dx.s associated with their slight estimated 

increase in murder and felonious assault arrests.^ By eliminating these 

•costs, social benefits are' in6;reased by over $150. However, the magnitudes 
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TABLE III. 15 ' 



SOCIAL BENEFIT PER PARTICIPANT OF REDUCED CRIME, MONTHS 1-27, BY TARGET GROUP 

(dollars) 



Ex-addicts Ex-off dnders ' ' ^ Youth 



Benchmark Estimate^'^ 1^677 -1,048 1D3 



Criiainal Justice 

System Costs Only . 1^449 -670 * 256 



\ 



NOTE: Values are discounted' to midpoint first ,9-month period at a 5 percent 
annual rate, 

^^This includes estimated benefits from net reductions in personal 
injury smd property dcwiage and the social component of stolen property cost 
reductions. V 
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of these differences axe small- compared to the combined values of all 
.benefits and costs. Therefore, using criminal justice system savings as 
a proxy fop social willingriess to pay for crime" reductions would not 
alter oiir general conclusions* 



REDOCEO ABUSE OF DHUGS AND ALCOHOL 

In general, as is shown in detail in the target group reports. 
Supported Itork'^did not have a pronounced effect on experimentcils' irug 
and alcohol abuse* There were no significant overcill changes in drug 
abuse^ for ex-addicts or youth, a small reduction in drug abuse for ex- 
offenders,, 2uid^ a mixture of ^increases and decreases in alcohol abuse over 
time for all three of these target groups. (Early results showed 'no 
evidence of drug and alcohol abuse among the AFDC target grov^ members, 
so questions relating to these activities were dropped in later inter- 
views.) 

Although no effort was made to measure society's willingness to 
pay for such chaoiges as were Observed, we did valu^ the direct benefit 
of the resource costs, savings f-.om reductions in drug or alcohol treatment. 
(Ind^ect benefits that might 'have resulted ^e captured in other benefit 
components .such as increased earnings or decreased criminal activity.) 

The estimated values of the changes in drug and alcohol treatment 
axe summarised for each target group in Tab.* e III. 16. The measured 
effects of Supported Work on the use of treatment programs (cpntrol- 

„ '^Because * the effects of Supported Work on drug and alcoTiol abuse 
were sioaall and v?\ri<3d in sign, the ;unmeasured benefits coming from satis- 
fying nonparticipant (and 'possibly even participant) preferences for 
reductions in these abuses would, in- any case, be small. 
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TABLE III. 16 



SOCIAL BENEFITS PER PARTICIPANT OP 
REDUCED DRUG AND ALCOHOL TREATMENT, MONTHS 1-27 

(dollars) 



* 



Benfifits from 
Rec'.uced Drug 
Tveatmerit 



Benefits from 
Reduced Alcohol 
Treatment 



Total Discounted 
Social Benefit^/ 



Ex*Addicts 



-4 



-3' 



Bx*Offenders 



-47 



53 



Youth 



-25 



-26 



MOVE: Values are discounted to the midpoint of the first 9-month period at 
a 5 percent annual rate. t 



S/oetail may not simi to total becaiise o¥ rounding 
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experimental differences in meaK number of raonths in treatment) were 

valued using the avarage costs of the *major^ types of drug and alcohol 

treatment progrsuns— nvethadone maintenance, residential and nonresidential 

drug-free treatment programs, inpatient and outpatient detoxification 

programs, and inpatient, outpatient, and intermediate alcohol treatment 
' / 1/ ' 

progfctms.— As cam be seen, the estimated overall values of drug 
treatment benefit- 3 during the 27 months after enrollment are negligible • 
The net effects are a $6 per participant benefit from decreased treatment 
costs for ex-offenders, but an increase in treatment costs of $3 per 
participamt for 3X-addicts and $26 per participant for youth. 

It is important to note that benefits from reduced drug cind alcohol 
abuse treatment may not appear in tlxe short r-on. Even if Supported Work 
has the expected longrrm behavioral effect of encouraging participcints 
to reduce their^.use of* drugs, the short-;cun effect could be either a (1) 
reduction in the heed for treatment, or (2) an increase in the desire for 
treatment in order to reduce drug dependence.^ When tifis is considered 
along with the weak effects Supported Work appears to have had on actual 
abuse, it is not surprising that the treatment findings are small and 
not consistently in one direction • 

G. USE OF ALTERNATIVE EDUCATION AND EtMPLOYMENT- SERVICES . ^ 

In the absenbe of Supported Work, at least some experiraentals 
would have entered alternative education and training programs. » These 
alternative programs generate a wide variety of benefits, cind costs in 



« Thes^ 9ost estirricites are' based on^published data regarding drug 
and alcohol treatoen^^ See Bjorklur)d et al. (1975) and Hertzman and 
Montague (1977) for discussions of treatment costs., ' 
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much the same way as Supported Work.' Their employment,, receipt of transfers 
, and criminal activity might all have been affected* Thus, the benefit-cost 
evaluation must be made in relation to the mix of alternative experienced 
experimentals would have undergone in the absence of Supported Work* 

The evaauation design allows this comparison to be made by using , 
experimental-control differences in behavior. .Controls? while being . 
prohibited from entering Supported .Work, yere ^allowed to enroll in 
alternative programs. They therefore represent an alternative treatment 
•group rath'er than a treatment-free control group; experimental-control 
differences in behavior can, thus, be attributed to the effectiveness of 
Supported Work as compart to the mix of alternatives experienced by the 
control group. ^ 

/ Because the experimental-control differences usqd to measure 

Supported Woi^'s effects already include benefits from alternative 
education and .employment programs, it is importcint to include in the 
analysis the costs associated with these benefits. 

Seven categories of education, training and employment programs 
were included. In each case, the differences in the meain nu^nber of weeks 
experimentals (relative to controls; used each alternative program were 
valued by multiplying them by that progrcim's average, cost per Student 
week, -^n addition, differences in registrations with the U.S. Employment 
Service were valued by the estimated d^^f^erence in mean nximber of employ- 
ment service registrations by tlie -average cost of^l registra^.ion. The 
estimates of average cost of the different programs described in mote' 
detail in Thornton and Long (forthcoming) are: high school ($46/weeky, 
^oca^onal school (?23/week), college and university education ($85/week) , 
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— • 1/ • . 

unspecified schooling ($Sl/week) VJIN training ($74/week)r CETA and * 

*i\ ^ 
"1 ' 2/ / ' 

lother training <$38/week) ^-^ public sieryice employment ($14/week) aind ^ 
ip.S. En^loyment Service (^43/registrati6nJ'- These estimates^ exclude 

! ' • . ' . ^ 1 • \ , \ 

allo%/atnces or wage paymelits to ^peufticipamts . . 

i The* results are shown in" Table III. 17. - As csua'be seen, the effect 

1 - ■ ■ ■ ■ ' • 

of Supported Work on e:q?erimentals* use of alternative e'ducatxon cuid 

'"\ ' ' . ' ' * ' * * 

en^loymentv programs in months 1-27 'was a small relative overall reduction 

: ' '\ " ' ' >^ ' ' ' 

foA.all tJuwet groups. . Ifone of the differences in average number of weeks 
enrolled in cuiy of the specific programs considered here was greater than 

' two weeks. (AFDC experimentals did, however, spend slightly more £ime in 

^ • * 

school programs than controls, although the differences are not statis- 
tically significant.) The estimated value of the resources 'saved because 
of these overall reductions ranged from ,$75 per participant ^tor the ex- 
addict ^!au:get group to $136 pey participant for the ex-offender grp^up. 
This .is a "benefit from both the nonparticipant and the social perspectives. 

We also estimated the experimental-control differences in training 
allovrances (from prograuns other than Supported wd?k) . A reduction in 

payments is a cost to •pau?ticipamts, a, benefit to nonpar1;icipahtSr 2Uid 

«> " * , . " ' • ■ 

does not therefore enter the Social benefit-cost calculations. The 

* ^ • I ■ ; ■ . • , ' " 

estimates, presented in Ta^e III .18, indicate that experimental. s in the 



s * -/when respondents. irepbrted beihg in $chbol, bbt did not 'report 

the type, :.t was /categorized as unspecified schooling *cuid the Vcifue 
;^tised was ti;e average of tiie costs of the other schooling type§. 

2/ * * • . • * - 

' ' - Since CETA fijnded* programs represent 'the vast majority of 

training programs available tp the Supported Work target groups,* all non- 

' - WIN training programs were treated /together using the average c6^s of 

• ' CETA Title I programs., . ii^' . ' * ' 

MRJC ^. \; . : 329 f- 
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TABIE in. 17 



BENEFIT PER PARTICIPANT OF REDUCED USE OF 
ALTERNATIVE. EDUCATION, TRAINING, AND EMPLOYMENT PROGRAMS, MONTHS i-27 

(dollars) - 



Reduced Use of 
School 



Reduced *Use of - 
Training and 
Enqployment Programs 



Total Discounted 
Value^^ 



AFDC 

EX'Addicts 
^Ex-Of fenders 
Youth 



-27 



48 



75 ■ 



61 



161 




133 








23 


/ • 


72 












136 


26 




87 



NOTE: Values aife discounted to the midpoint of the first 9*-month period^ at 
/k 5 percent annual re^te. . ' ' ' ^ 



a/. .^-^ • : ^ 
Details iyay not sum to' totals because of roundiAg. 
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TABLE III. 18 



BENEFIT PER PARTICIPANT OP REDUCED TRAINING ALLOWANCES 
FROM ALTERNATIVE PROGRAMS PAID TO EXPERIMENTALS , MONTHS 1-27 
(doUars) , 



• Target Group.- . ^ 



TotaU. Discounted 
Value of' Change 
in Allovamces 



.AFDC 



-10 



Ex-Addict- 



13 



Ex-Offenders 
Youth 



32 



IK>TE: Values are discounted to the midpoint of the first 9-month period at 
a 5 percent annual rate* 

/ 
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AFDC and youth grotjqps received more income from traixiing 2d.lowances than 
did controlSr while ex-addict emd ex-offender expefimentals received less. 
However, all differences are sznall«_ 

A caveat is necessary* with respect to tJxe interpretation o'f " these- 

results. If the ^valuation period were long enough for atll the possible 

. — i , : ^ 

future effects of Si^ported Work and the alternative progs^ms to be 

reflected in the e^qper imjgntal-cqntrol differentials xised to estimate * 

those effectSr our procedure would lead to unbiased results. Because the 

ev2iluation period is finite^ -however, we cannot be sure there is no bias* 

If, for exan^le, the short evaluation period ineeuxt that controls 
did not have time to conplete the education and employment altemaf res, 
observed control earnings may understate the earnings to be expected in 
the future and lead the e:5>erimental-control differences, thus, to -be 
overstated. If, in contrast,. Supported Vork motivates paurticipants to 
obtain additionaLL education and employment services they would not have 
obtaujied if it had not existed, the^ finite nature of the observation 
period will lead, by anailogous- reasoning, to the long-run earnings of 
e^erimentals being- understated and the effects of Sv^ported Work on 
eaumings (i»e», the experimental-control difference) f consequently / 
understated as well. " > 

One way to avoid these biases in such a. short-run evaluation 
-wotild be to incorporate estimates of the returns to investme^s in human 
capital "into the evaluation In this way t3ie present value of any 
f utiire eaurnings gains associated with paurticipation in alternative ' 



^ Such estimates for schooling aire contained in Jacob Mincer 
(1974) and 2vi Griliches (1978). * 



prcgraiRS cbid figured into pur eistJj^ of the Supported. Work 
effect 6ri:ibng-nm earnings- For several, reasons this method was not / 
adopted*' Firsts the inq^usion of these estdinates would lead^tb^the^ 

doubie-^counting of some earnings gains ^ unless the -effects of 'such htiman^ 

. - • • • . - .^>. • - . 

capital investments could be eliminated from our direct iaea^^iz^e^^of eam- 



ings based on interview data • Sieicohdr many of the studies that • estimate 
returns to education deal with populations that are not nearly as dis- 
advantaged- as the Supported Work target, groups; therefore, tlieif estimates, 
may be inappropriate for this evaluatiorii Finally, it is hj^t at all clear 
that the returns to con^letdLng an education or training program can be 
use<i to infer the returns to completing a portion of a program,-^^ Even 
for those cases in which returns' to' a year of schooling have beeix esti- 
mated, these estimates are inappropriate for valuing the chauiges of a 
few months of discontinuous/participation* 



• -r There is substantisG. evidence of a "diploma effect, in which 
the bene tits, » from conblet^ a 'program a're si^ificahtly higher than 
those gedned by almost completing the program- 
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oyERkn^ BEsijL^ Yofsra target group 



As in the. case p£ tiie -MTC exraddict target groi^^Sr the 



benefits of Supi^^ costs d\a:.ing-^TO^^ from, the 

y?^^ ]?*^ DhU^ residts for the o6ier; %:Wo 

.gro^^ however^ fTOmiBptfr.^tiie. social «d nbripajrt^ 

=' - i'^ ' \ ^- - V ' * . ' ■ - 

benefits fe^i short, of the costs for the youth group., As Table ly.l 

shbwsir this is^becat^ from to^ir ijii^prograa: 

earii^^ \(3^.ut $3^ 690 per pa^ which, exceeded tieix costs \^ 

jfc^regone^^ e^unfxihgsr increMed?taxeSr^ welfare payinent^Kby \^ 

about $I,800r- From the social persp^^ were very snail and v 

weire fef outweighed by cbst^. Social costs totaled $5^000 per piarticipant^ 

with, the only' subsl^mtdal benefit to offset it frpm the .social perspective 

being in-program outp^1|^ valued^ a per ^participant. Other. , benefits 



totaled only about $200 per .participant\resulting" in a negative net 
present value from the social perspective ofl^$ir377. From the perspective 
of nonparticipants, the sit\iation^ was even jforce^ with benefits falling 
short of costs by almost $3r 200; - 

The pattern q£ b<mej^ts and costs over.t±B^. (shown in Table Iv.2). 
was simi^^ to that for ;the AFDC and Jexraddict target groups. Social 



r^^As can .be seen ijx Chapter pkrt of the^ reduction ihr trimsfer . 
payronts is ;Ln pa members (presunobly patrtdci** 

pants ? :parentsKi ' 'rids is tinted: ,as a cost to participaiits' although' it; ^ ^ 
is. "teciuiicaliy a TO^^ j 

. -^ yputos^ a^^^^^ in training allow- 

ancesr and. siaiall^ nieas^^ reduc^^ iix post^^^^ earnings and stolen 
^ gropertyv ' * " \ ' ^ \ 

& 'r ■ :, : •.■335';." ' 



• v-^Tm^EpRT^ 



SocUl - Participmt : - -Monptreleipant 



3,394- 


0/ 






-3 


-3 






0 


r30l- 


301 




















0 


-474 


474 




73 


6 


7f 




























•160 


6 


-ieo 




7 


-4 


11 




256 . 


0 


256 ^ 




~ -26- . 


^ . 0* -? " - 


-26 
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• 0 
4 
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— conty 



^•^ Pro j ict^cofti" ~ 

it. Central ^;ultticlsti»^^ 
ill. ?«rricit>*« 



-2,136 
-1,697 

-203 



0 

-974 



y 0 



3,551 
-974 



: . ^2 »136 
. -1*,697 

-203 



-3,351 
0 



•a 



- • ' ** 



-rl,jn 



'1,5C3 



-3,177 



-NOtEt' OMpoiMati' bjm:b \«nd^ «ttimat«d -</tittM ,«ai«r«d.' According, to i pripr^^«xp«eutiofM 



.#1 




benefits and costs: fr^^ perspectives , by. time; period 

" ; youtCsSwFi^ * ' . . 



- ' . ' .^^ v;^ 



Mgiiths 

l-:9 ■ 



Months,^ 



;Mdnths-: 



Social; Perspective . ^ 

v)^nefits , ^ - . . ' " . 
^ yalue.'pt in^^ ^ ' . " ' • 
Increase fringe benefits 
Reduced 'ad^nist^ of :i::j*ansfer prbqr^ins 
— ^ R e du s'g d'^ COS tV o f-^eiAmwaJr-art^t^ ■ — : — ; — 



'2,-359 

" o 

4S 



:R4duced >cos^^^ and ti'aihinq prbgraiotis 

,feduqed drug ^aiUi aicohdl treatment costs 



' .Costs . _j . . ^ 

'rPrpgraja^ pper^tting and central .administrative costst^ 
;Foreqohe earnings plus fririge^bene fits " 

* • ' 

■ l^t Present Value (Benefits minus Costs) 

Participant Perspective- . * 

' Benefits * . ^ 

Inrprqgfam; earnings plus fringe benefits , 
Increased pqst^prpqram eTarniiigs plus fringe benefits 



89 
-^6 



-3,163 
-700 

-957 



721 

18 . 

. -4 



«857 
-265 

-619 



-43% 
\65: 

-18 



-51r 

-20 
190 



' : t 

ft 



Costs 

Foregone/ earnings plus fringe - benefits 
Ihcreasfi^d; tax payments ^ ^ 
. JReduced ti^ansfer payments 
Reduced' training allowances 
- — -Reduced 'Stolen* broparty""^*-"™' - 

Net /Present Value (Benefits minus Costs) 



2,770 


754 




58 




58 


-126 




65 




-700 


* -265 




-20 




-265 , 


-28 








-329 


. -102 




-51 




' -14 


-16 




* 35. ■ 




•5 : 


30 ' ' 




41- — 




1,526 


248 




38: 





NOTE: To facilitate comparisons bver time, ber.efits and costs haye been discounted. A positive number is a ^- . 

benefit; a riecrative niuhSer is a cdstw . « \; 

. ^/This is the sum. of reduced progert/ damage and ^^ersohal injury # stolen property, andncflminal iustice systeni. costs*. v. '-^4 



7%his is, .the sum of, prplect , over 



x tsf daj 
head,, c 



and central administrative costs* 



. ;ben!||±^^ f ell . most short dttting months 1-9, a laurgely iri-pro'gramv 
. ;peridd/ and.;they con^^^ued to ,f all .short l^ing months 10-18, primarily 
ibecaiise estimated, yaliie of ih^^Mgrap output did not coVer costs* Unless 
V there are sii)stantiai unmeasirced,^ diiring, the in-program period-- 

. ^and,. -given societyJ.sTpr.eference^ to have youth working, tK€r(^^ednDa:d~bB-- 



> . whetheif overall net. present, value is positive from 'society ' s perspect:ive 
•for youth,^depen^ future:;;behe From the, .peurtiqipamt 

, tte \inrpro.gram^^^ net incomes increase.^ the most, largely* 

because of Supported :t:brk e&rhings^ participant benefits still exceed 
: ' costs, in months 19-27 , feut-^only $38 per ,partic:ipant • 

\, From'tdle nbhE^fiurtic^^ _ 

' «again, the worst dxucing^months 1-9, when nonparticipaijt Benefits fell 
^hoxt~oT^¥ts by^^ period, _the„ 

hokiparticipant results improved but were b§u:aly .positive by months 19-27*^ 

Table fV.S- shows* the alternative base period^ estimates for 
Extrapolation of the youth results. There is little evidence of benefits. . 

beyond the 2f7th month. .The 36-npnth cohort Vesxalts show* negative, benefits 

" ' - ' '-' ' , ^ 

for post-program earnings and criminal activity during this period, although 
- both could be the result of chance sampling variability. For this target 
.group, too, ^ the Se-rmonth youth cohort^ was small (the smallest of ail target 
grpujps) --153 observations— ^reducing the reliability of the 28-?to-36- • ' _ 
jriohth. results. in any case, the estimates of program impacts in 

this^ later period provide no indication pf long-term benefits for youth: 
when^the benchmark cohort adjustment is used, estimated social benefits- 
in ninths 28-36 are close to zero (-$15) . 

,..-'^v " ./ . '/ ' '.381 ■ ' ■ 
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TABLE IV J 



MEASURED SOCIAL BENFJ^ITS, ALTOWBVTIVE BASE^ jPERIOD ESTIMATES 



YOUTH* SAMPLE 



Benefit 



Months 19-27 ' 



M6nths^a-^6 



'Increased.Post-Program Earnings plus Fringe Benefits 
. Reduced Administrative Costs; of Transfer Programs 
-Reduced. Cost of Criminal Activity 

ReducedJtDr^u^ Treatment Costs - 



Reduced Education and Employment Costs 



65 
17 
165 
-18 
-11 



fi 



Total 



21g 



-346 



10 

-169; 

0 
38 

-466 



■ Benchmark Est te . 



- '5; 

26 
-34; 



-15 
2 

-15 



NOTE: . The results given in the table for months 19-^7 are for the fuil 27-roont)i sample (which inclUies the 27-moiith 
'>-A^d^^he>36^mohth^QhQrj:s).i -th ose for mo nths 28 -36 are for the 36-month cohort; t^he- benchmark estiiiate is the 
weighted average of (1) the. 19rto-27-month results for fctiQ 27Haohth-cohort- and (2> -the 2a-4:fc^^36rjaonth„yegult3: 



1 'for the 36-month cohort. 





\ . 
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Table- IV* 4 presents the benchniark estimates from all three' 

- . . • ■ ■■ ■ ■ 

perspectives* ^Given that benefits after laonth 27 axe essentially zero, 
these results qliff er little from those based on data for the first 27 
&5nths only* 

These conclusions are 2U.so remarkably insensitive to alternative, 
ass u nr p tions , This is apparjBnt^inJ Tga^le ^^*^ v",which presents the . sen$itiyity 
tests for the youth results. Only if participant labor from society's- * 
perspective is .5aissume4 to be free (i.e., the shortage labor market model), - 
does net j)resent value become positive from the social guSa* nonparticipant / 

perspectives'; with minor exceptions, it is always positive from the% 

1/ * ' ' 

participamt perspective.-^ , - " . • — 

i# • * ^ 

Thus, ,we conclude that, based only on the measured beSiefits and 
costSr. the results for youth aure clear-cut. Beneifits fell short,.pf cpsts - 
from the social and nonparticipant perspectives, participants were made 

) • ... 

better-off T-but-orily-as-a-re3iilt~of^4dieir-^uppQrted.JW0rk^_ 



How one interprets thaSe results depends on how highly un^efesured ^, 

benefits cure valued. One of the original hopes for Supported .Work was 

' 

that it would encourage youth participants to return to school, but 

Maynard (1979) finds' no evidence that this hope was realized. Neither , J 

was there any evidence of is^royed health status or "Mb^uced drug use. 



. * Supportied Work did, however, put the youth participants to work 
dufing. tiie ^i|V-*program peridd, auid judging from the laurge number of youth 



1/: r^^ 

r As for^the APDC tatrget. group, the few negative estimates from-^ 
the peurticipant perfective afisei because at- sizable ^timated reaction * 
ixi trauisfer'.paymen^^^^^ the base period is extrapolated into the / 
future. It se^ms unlikely that such a reduction in transfer payments ( 
would persisjt fax int^o. -the. future, however, given the other • indications 
of future behavior bnr^tiie. p^u:t of this group. '* • * / * 
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TABLE'IV.4 . . ' , . 

• BCOHMIC gS Tg U T KS OF SdCTXTS AHD COSTS TCH 9JUerZCZ9MIT, SY ACtOO!fTX:iS ?IM?XCrXVI 

.Z4 oa^t >rro4ttCttd*by >ftrtieip«ata ^ , . . . , ^ 

"^.•-^ Va1u« of ln-f7w^ra» oatpjt ^^^^-^-'^^JTiX 0 3,354 

pXus Www ' ; ^ " * 2»^« ^ 2f^/ ^ 0^ 

. • .frtf«r«ae«s for vork ov«r wtlfara ^ - , • -i ^ ^ 



IX.. xacxcftM^ Ite nyMttts - , 0 y34l *~141~" 

ZZZ« Mducod bopMdMca oil TraWf or^ rroqr«M / ' * 

• Mucod tvansf«r,p«yMiits . 0 «l«3(I I«3<I . 

ZV. iMueod Criainal Xctivityr \ 

' • Mucod prcp«rcy d«l*9« and . . ^ ^ r » ^ o 

. p«rfoaai injury' ' * . -1,346 ' 0 ^ -l»3a 

• Mt|^ icolM ?rop«9ty ^ » S : 404 -218 m 

* • MttcM 'jostie* »yst«i*costa' '5^-/ 1 *'^*/ 

• .lUdiicod psycholdl|icAl cottJ . - . • - ' . ^ =^ - 

V. jMueod, Drug Aiid;;AlcohoI Cm * , , « . 

Mucod tro«»oftt costs ♦ ^. ♦ * * "^^a/ 

• ?tychologlc«i bsosfits . 7 - ^ ' - 

' yx« Roducod Dm of Aitamttivo eduuation* ** « ' /' 

Trtiai^* «ad Saploywnt Sacviets ^. . ' i> 



Muead ^aducAtion ^nd ^lcy»«hV<»»ti --vlOO ^ ^ ^ . . . . 
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• RAdijcAd trminlng AllowancM^ • ^ 0 ^ . 205 "'^-•^^—20$ 

• taproTwi participAnt ,hA«3kh stAtus ^ TV Sy 'f/ 

• XncqaiA redistribution * — - . 



COAtA ^> ' ' ^ ' 

I« TroqxXM OpATAting COAtA ^ 

• TrojACt coAtA - ^ •-2,136 0 ^ -»S*136 

• OvArKAAd COAtA f y -l#6»7 . . 3 ^ -t#697 

:X« CAnttAl AdAiaiAtratiVA Co^ts -20:3 0 •293 

r:z. pATticipAnt Labor CoAtA 

' * » . • - * ' • , • 

• Zn-progrAB AAmin^A ViuA fringM 0" 3.551 -3. SSI 

• rprogonA A^rsihgA pIuA JringAA ' • . , * ' "^^^.y * ' ^a/ 

• 'rOrogOM lAiAUTA > - • • 

17., incrtAAAd abric lUUtAd roAtA'^ * ^ 

, .'V ,; ^ V-.' V 

V . . . C • ■ ( • ' ' , ■ ■ 

HAt »rASAnt VaIua (BAnAfitA sinus COAtA) t ^l,Ai% 392 ' -2#3S7 



i 



\atii Aa Sa/ota, th« c^pohAAtA ArAOxAtAd iecording to tbAir ♦xpACttd stAtuA aa bAAAfitA or soAtA ttm thA 
sociAl ,;crAp«etivA« '4rbAthAr thA ditA AbpwAd thA« to bA nAC^bAnsfltA or nAt coAtA or OAithAr Ia indi' 
^ CAtAd siy (*) or .(^) „ rASpACtiyAly. 



A/ # * * . . 

^TbAAA bAaA^itA;AAd COAtAtVAtA nOt MAAUTAd 



:^>...34I ■ ^^^^^ _ 



Jr. • ■ 
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' . - TABLE IV. 5 «^ : 

NET PBESENT VALUE ESTIMATES UNTOER ALTERNATIVE . ASSUMPTIONS 



YOUTH .SAMPLE 



Social 



^Perspective 



NonpctrticipantVc ^ 



4 Benchmark Estimates . - ' 

" ~ ^ * ^ ' • - ff 

Extf apolatioh' As3tian4)ti6n*s 

* Discount; rate =» 3 peojcent 
piscotot rate « 10 percent 
, . Tiiher Horiz^ bene'feits , . • 

'bfeypiid: 27 ^nuDnths * \ 
. Time Horizbiv; No' benefits 
beyond* 36 months 
Decay Rg^te* 3 percent. 
Base =? 19-27 month results^ 
Base = 36 month cohort: ' results 
(without adjustment) 

, Employment Ass 



1 



Shift from siarplus-Vbo shortage 
market - \ / * 

- Shufflin|[^workers" ani)ng joSs 
' CETA-WIN PSE wages valued at^ 
. .. -50 percent ^ ; ^ 

Cost 'and Value of 'Outpjit 
• Assumptions . 

Value of output equals revenue. 
^Inciulibn of steurt-up costs 















-1,465' 






892 




. -2,357 


-1,4.8-1 i( 


-16) 


768. 


( -124) 


-2,249 


-1,434 


( 


+31) 


l,llC^ 


C +222) 


-2,548 


-1,37,7 


( 


' +88) 


l,800''i( +908) . 


-3,17.7 


-1,390 


( 


+75) 


1,661 


(~-~?^9) 


\ -3,052 


-1,597 


( 


-132) 


-478 


(-1,370) 


-1,W9 


-250 


( 


+1}215) 


1,799 


( +S07) 


-2,049 


-4,118 


( 


-2,653) 


-379 


(-1,271). 


■ -3,739 


17,999 


(+19,464) 


892 


( +6) 


17,107 


-1,777 


( 


-312) 


892 


( +0) 


-2,669 


-1,566 


( 


-lOl) 


892 


( +0) 


-2,458 



-2,999 ( -1,534) 892 ( +0). 
-2,425 ( -960) 892 ( +0)' 



-312)j 1 

^ioi)''/4 



-3,891 -(-1,534)"^^ 
-3,317 ( .r960)' 



_ Crime Asstmiptions 

iib crime 'benefits 
50- percent of crime benefits 
Criminal justice system costs 
oiily 



-1,376 ( 
-1,429 ( 



-523 ( +942) M, 109 ( /+217) 



+89) 1,109 ( +21-7)^ 
+45) i;001'( -+11 




-2., 485 (• 
■2,421 i 



4124), 



-1,633 ( . +724).; 



NOTE' Numbers in parentheses shov the amount and direction of change from the 
appropriate benchmark estimate given. to the top line of the table. 
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3.42- 



apsployrcnt ipxpgx9m initi'atiyesv this; seems to be sbinething society 
desirres to: do. Indeedr proyidijagry^^^ initied work e:q?'eriencer 

as -mehtipned. in. Chapter I, .has long Wen ah obj^tiv^ of eipldySerit. 
j^rograms :for youtH> in addULtiorir .^^portedj^drfc.ha a 
todest_2U»imt-"9f another uxuneasured benefit of 

Suppprted ^forkr ea:though tlds/he^»beih ac^ at cohSiders^ie cost. 

overall assesjsment of Siqpported Wpr^ for the youth target group, thus, 
:depends ion how much society/ ahd.particiiijurly nonpaa^ are willing 

. ' ; ■ - ■ . , 

to pay -to put youth td wofk and redistribute income from the rest of 
society to them. If Supported Work for youth is to be continued, the 



absence of sybstan^^al benefits other than value of output suggests the 



1/ 



need to search for less costly jobs yith higher value of output.— 



\ 



^ lia.YmiZ& (1979) does find (admittedly weak) evidence that younger 
members of this gtroup (who in the absence of Si?)ported Work are most 
likely to be xinenployed) seem 'to do better, suggesting that it may also 
be desirable to atten?>t to target the program at younger applicants. 
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cov^ARisgti^^'rq other benefit-cost sto of eotloyment and training programs 

Benefitrcpst ancU.ysis has been. applied to a number of employment 
""aii^^trSIhing programs, over" the. past fiSehTQ; years-T,JTJ>is'ch^itef attempts 
to- compare the xesults of these studies with the results presented for 
SuppprtfeC Work in .this report. . It must, be stressed, at the outset that 
comparisons, aitt^ are difficult to make and, when made, suscep- 
tible to misinterpretation becaus^^of inevitablj^' differences among target 
groups served, prevailing economic, c nditipns, and analytical approaches 
used in the evaluations. -Nay, Scahlon, and Wholey (1973) struggled 
with such' differences in an es±lier comparison of benefit-cost results 
.for employment and training programs and concluded that "interpretations 
and comparisons of benefit-cost , ratios based on the numbers alone, without 
regard to t^e particular viewpoints and definitions behind each of the 
numbers used, are almost certain to be misleading." Although these 
difficulties make any strict comparison of Supported Work relative to 
all other employment and training prc-^am^ impossible, useful research^ ^ 
and policy implications can be drawn from an .examination of other benefit- 
cost research. • — - ^ 

After a general overview of major beiiefit-cost analyses undertaken 
since evaluations of four programs serving target groups that are 

^'^Stromsdorfer, (1972) and "Cost-Benefit Analysis and the Job 
Corps" (1979) also mention these difficulties in their comparisons of ^ 
benefit-cost analysis. 



o „ ' 398 

f ERIC " " ' 345 



-simiiar to \those serveid; by .S^p will be examined in detail.. 

' - .-r. ^-' ^ . r s . . ' 

/AV PVERVIEW pP :PWSVIOy^^ 

Table V.l . present^ descriptive data and results of the major 



•benefit-cost of employment and training.programs that hav^ 



been conducted ^ince 1960 Looking at the last set" of columns of: .Table__ 
VH-r.l^ we can see TJiat the vari^^ is quite- striking. ^ 

The benefitrcost ratios presented range, from less than zero to over , .* 
100/. iifiplying a wide variation in the measured costT;effeptiyehess of 
dxffereht programs. As can also be seen from .the table, the progrcuns 
varied widely in target groups served^ urban/rural orientation,, and 
inacroeconomic conditions. In addition, the methodological differences 
from study to study aure so importcmt, in some cases that comparing the 
bene -it-cost ratios of the studies is meaningless. These differences 
are, of three general types: (1) the quality of the outcdtne- measures 

(comparison group and statistical methodology and ssunple size) ; (2) the 

\ ' • ' • 

accounting framework (benefits and costs included and perspectives 

taken); and^ (3) extrapolation (discouJit rates, decay rate, and time 

horizon). Each of these ty|>es of differences will be discussed, along 

with the implications for comparisons among the studies. 

. ' ^ .. ... " ' 

As in the Supported Work evaluation,, outcomes are typically 

measured by computing differences for variables such as earnings between 

p?irticipants • and a relevant comparison group. The ideal way to measure 

these differences is to use double blind random assignment of individuals 



3Bi) 



AroaiRiKl^yelopMont' Act 
'^iARA)\aTid^' state; goycr n- 



J'Tar9«t::Croup > ? : Provided., 



:p«riod 

:study 



tociis of 



'icain and St reus- , 



MM arid state 

^ovttriiMunt ^ pt^ra 

'{StrdiR9dorfer,N 
1968) 



XRA and Haiipowcr 
Develofiinont' and 
Training Xct <HDTA) 

iitfardin and Porus, 



ilibrus, 1964) 



NIITA 

|S«Well» 1971) 




" worker s-'i'n' 
areas!" • ' 



Classroom 

list^^tion 



1961-62 



Mest Vir9inla 



-Peiie£it-CoRt; Wtioaj ^ , - 

rrcfet^Pri^it^Vaiue^perrp 

.. Hale V ^ rcawaio'- - • -"Al"i^ 



5%N d i scount 16 . 5 ; -3 .-3/ \ . . -J J f :r 

irate ($1^,200) m#234^> , : ffiPi;^^^^^^^ 

10% discount 10.5 . 2;9, / 'a',^?:: . J .f l 

* rite ($8,732). •<$9ei) . V :<$6,S53)>^^x 



uivMiployed' aiifi . - 

underoii^loycd 
vworkirs, in depressed 
^areas.^ 



^^ClassrocM 
■instruction 



1959-63 N«8t Viryioia : 



4i:^discuunt 
".rate 

6%' discount 
.rate 



Male ' 

^1576^ 
($33,382) 

14.6" 
($12,482) 



ale^ 



Unemployed and 

imderesiployed 

workers 



Classroom 

instruction 



1962-65 Michigsn 



60-200 
"^U7,34, 
($5,654) 



•Hours of Training; 
201-600 60£fi^200 
-0.03 "'-0,34;^ 
($-912) ($-2,925) 



($5|7>3)?.^ 



- "^'f70;25^v^'jjt 

(AsfiiMpt ions *of .10% di scount rate nmi^lO^yeAr/d^^ 
tion of Iteiioflts- we UKod.) . ^ ^. >v - > I -<X{ 



Cxperitnced sienbers 
ill work force. suf- 
fering, high un««- 
ployMent 



.Classroom 

instruction 



1962-63 Connecticut 



18%. flow per year out of 
occupations whic^ use 
traihin9' \ , *t 



73. 3V 
($20,869) 

103.8- 



Rural clientele,. ■ 
Moitly blac)c/,Wale, 
hejpkds of families; 
m<iny/f arm workerji^ - 
'6i underemployed. 



Classroom 

instruction/^ 
drr 



1965-66 North Carolina 



18% flow per year for first , , 

three, years, ttien 0% flow \ \ ($29;677); 

- ' . s ' 'institutioMlf}; 
OTJ'WaXes > /.\>)i>iss"^-'^ ^.^t 

i 3:3 : ^'i-;7/' ^ : I 

($2>7fli)^ ($1,866); ^ 



Training! OTJ Females 
($6,920) 
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\' f'*> ^^v '^'j.'^ ' ' 1 ■ ' ' 




V, . ^- ^■c^ ; '-^1 t\v ;i4t'- 



00 



;'Hei9ti^rlii6^ V 'ifowtli8--r< year*; 



rrovidod" 



study. 



Study - 



/Jtob'iMrket' 

^orl^tition.^,- - 



a965-:67 



Nationwide 



lkfimat-bo«t-RatiVs; "^^^ - 
(Met rrescnt Vaiuo j^c^yartlgriian^Al.. p^^^^Vk:^ _ ^ 



NYC>butrof<- 



Ydathi;^7ljS\yeJL^^^ 
old -"•ikI oid«r 



Skill xtr«inlii9, 
;pl«ca»cnt 



1967 



Indiana 




, ijtorus^. 8cen^ , -^arid . 



, Hyc; ^ 

Halo . ^ . FeiMHo 

Poregqno; ^ ' / ' ' 
'carnliigS' '2.8 .4- 



Mciifora- 
gone*" 

aarnings €,t 



.9/ 



:2.i. 



(Results aro fbr^tlwse Uth'lO/years of : educatiotu ) 



Job, corps ^ 
(Cain. 1967) 



b i sadya|i t'agj^^^ sen 
.and voMen ^gasUe 

to 21 ~ wlio ' are^^ out^ 
of .wo^^^atid ';iack' 
Mrketa^le tjob: ' 
skills * * ' 



V Ba s ic .educa t lo n , 
'.hightacliool^ oi|ui- 
valency. Instruction, 
skill training, 
.work^experience, 
place«ent > 



1966 



Nationwide 



3V discount Lr 
rate ^ 

5% discount 
' rate 



ediWationar 

liv.tfainsU 
1.22^ ; 
($780) 

.79 
($-.746) 



Job Cdrpu 

.(Thorndiit, tortg, 
and jna liar, 1978) 



WIM II 

'(ScltiUorr ,1978) 



Sane as above 



SaMO as above 



1977 



Nationwide 



Discount 
Ratoi 



_ 3v 
1.15 
($757) 



^^tUafe 
Cains:- 
-1.45! 
M$i,6>6); 

. . ;i .04r' 

($i5a) 



£10VV^ 



l^iOS 

($251) '\ \ (V-582) 
bonotit; decay, rate Jier ifear .was 
used , ) . ' . / .1 . 



AFOC' recipients 



Job search, 

education,^ 

training* 

subsldizea 

employment 



1974-76 



NAticmwide 



"1% discount 
rate 

6% discount 
rate 



Males 
2.11 
i($fMI) 



1.74 a .18 

,($561) ;^!v.%<$?oi) 




(AsstMiptlon of 19% boHOfit.dc'cay Vatb (i^r 7^^^ 1^^^^ 




lTafeii::V.i (continued): 



^ ti vi ti9^x nsur Attca: f or 



jTw'et 'Group 



Services^ 

...J Provided, 



>eribd' 
ofx ' 
Study , 



■locus uf 
. Study . ^ 



, Qte t Present ya lue' ^ i>or 7Pat: t iclpaiV^U li/ P/i ten ttveTgag ) 



.Wildcat- 

:(r'riedMin, 
1977)/ * 



Wildcat 

(irriiidi^n,. 
1978) 



NatioTMl Supported 
Work < Dewonstrat ion 

(Kei»per« Ion9* 
Tlwrntoh, 1979) 



:»tai(b»? r^leawftd rf , 
Wr y ialid : pViTOn*" 
i»adrlVi9i> probability. 

'6ryo«iilttii»9 t^ , 



{.Transfers 



i^-addicts with. 
<rec6rd?9fr 
uneppioyvicnt 



.Teii^porary 
epploymont 



Ex-addict tt wtt^ 
recbid of 
unevpioywont 



Teiiporary 
eiipluywant 



tfx-acmictSf 

ex-offenders, 

youth 



Tcfliporary 
canployneiit 



1972-74 



"BaltifKorOf 
Haryland 



U^ir 'Bouiid' 



=53 i7; 



(5> dliJc«int>A^,^nb>^^^ 
decar^fw^hoc^ 

est ijaa t e I H^^iii^coup^ 'i?!??^^ 0*1^^ 

benef 1 1 s tand^l 4 i/ di$ay> ra te ^ f orVo t W t ^ a si - 

;8t<itfd ' id r aower txiuiiJ < ea t iiwi te^ivl- y-. ^-'-^—^ 



1972-74 



Hew YoKk City 



1972-7^ Hew York City 



i975-7J NaUonwide 
(10 cilies) 



^ - , ($2 ; 207 )1 ' , : , * ^ 

(Benefits and costs cover\fir8t* ,ye^r^^ 
enrbn»ent.)' 



;($1.670)^ . ; 
(Benefits and costs coyer first 3-year8 following 
eiuroiiaont.) 




--^ils5«»ption of 5% discount rate, 3% benefit. decay 
rate for WOC and 17%; decay rate for ^t her groups. 



rate lul. 'nffl»^- oifw »« »^ "-m -^w, - 
V^r ^ ^Mcd for MTTtr^Tf'^'^ <^«HiLitea.> 
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tQ ej^rimental .and coh^trpi groups,^/ so. that the measured differences 

/ ' - ' ' ^ 

between ^the two groups are -contrblled^ for and uhbia'sed^ estimates of 

the impacts 6f the^pogra^ can be pbtained. When/such a foxroal experi-.' 

mental- .design^ is hot gbssible, a cbmparisorTgrb mu3t: be chosen in a 

way that minimizes isources pf potential bias, , Any differences between 

the "two groups for which, the istatistical estimation procedures do not 

control may ixipart biaseii of unJcnowh direction and magnitude to, the 

> ' - * ^* ♦ 

measured effects of the p'rogremii 

. Table V.21 suicroarize^ methodologies used in these studies. 
Of the analyses covered, only LIFE used dpuble blind random assignmei>c. 



Three additional studies— the Supported Wdrk study and the \wo Wildcat 
studiesf/-- -used random assignment although the experimentals osid controls ^ 
knew to which group they belojiged. The other analyses in the table used 

comparison groups of varying quality—^some .used early dropouts, some used ' 

/ * * 

applicamts who did not enroll, and others used nonapplicants who were 

similar tj the participants. Of those studies that did not use random 

. 3/ 
assignment, all but two*— used statistical techniques (typically multivariate 

regression) to control for any. differences between the treatment and, 



^ — In a double blind experiment program operators do not know ,in 
^vanc to which treatmervL group a person, will be assigned, and experimentals 
and controls do not know to which group they themselves have beei;i alssigned. 
^en controls know that they have been rejected from a prognam because it is 
an experiment,' and "^experimentals know they are* participating in a program 
that is being evaluated, the knowledge may affect their behavior in unknown 
ways^ — A^Qu ble blind exp erimen tal design avoids thesQ biase s. 
2 

— The data used for the Wildcat studies had an additional shortcoming: 
those in the^ej^'perimental group who did not participate in Wildcat were .not 
interviewed, propping these experimentals fflay have introduced additional 
unknown biases.' . * 

3/ ' . 4 ' 4 • " 

. - " — See ^Cain .and ,Stromsdorf.er (1968) and Cain (1967) . I 



A COMPARISON or DBHffXT-C05T Sl^^ 



WAJNIHG PROGBAHSi HCTMOOOLpqX; 



pr oqrn_ 



CCMf^riion Croup 
Hethoiiology 



Benefits : 



Coiti 



Di ticouht pur a1 ion : 



i^^erimnt;pro9rW 

'strcMfidorfer. 
1968) 



Sonf^^dMtU ' 284,caH>«ri*(>n 

noMppliouits 

CunMployad.perT^ 

•ofu, f ro« •i^loy*- — 

Mnt, Mrvic* 



:IncreikRc4 MrniKgs' 



Pro9ra»tco»t» - 
rore9<m* •arnlnga 
Increase in,^ tiJinsf «r~ 



iv to 

8* . . 

lot 



goytrtiaont pro^ras 
(StroMwlorCer. 



SaiM aa abova 



879 total Iitcreasod «arnln9a 

332 txparioantal 



Sa»a an abova 



4% 

6%. 



AAA and MOrA ^ 

« * 
(Card in and 



Pro9raM partic- 
ipant ' - ' 
with tlioita vtio 
~»ppliad'aiid- 
accepted but 
did not enroll 



503 axpariaw>ntal 
281 comparison 



Increased earnings 



Program costs 
Foregone earnings 
Administrative costs 



5% 
10% 

15%. 



S-lUrlS 
years 



MDTA 

(Dorus. 1964) 



Ho comparison 
group used- 
see comment 



373 experimental Iiwreased earnlnga includ- 
ing multiplier effect (as- 
siwiing a multit^tl^f of 2) 



Program costs *«xclud*. 

ing transfers and use- 

of buildings 
Adainistratlve costs 



5% 10 years /.A«sumid. xero op-. 
/ ^ |«)rtunity cost of 
. labor* 'Mnefits 

• average total e^rn- 
ings-of t^wse-Uio 

' U8t»l t lie ir^t rain- 

• iiig mnltipli^ by^^ 
tlib ;)rol>Abllity'of 
uaing^ t\vts\ irairiiiig 
after completion of 

*tlio ciAirao. " Itorun 
I IMde alternate as- 

_ . ^ — -r~sumptlo4»S4as.tOv.tbe^ 

^' ^ f Inw out of thofte 

occiipatlons nyet * ' 
^ ^ .tlte 'lO-y*\\r lietief it 

period. ^ 




■A 



to. 



Table y>2 ^(continyi'ed) 



pirn 9iW' 



V 



C6«ts 



Mitt 



^mtm '«4ip did i^t 



3(3 •MfWimmkiml 
'192 CKHi|iM:iiibn 



AAaiiiUuativ* costs U% 



to ays 45 



.NVC** lb-School 
aid fuMMr rro^ 
^riMS 

(Sonsro Sfid 
SUuMdorCori 



pMts-^OQoiiArsd 
wHK'iitudsMtt Uio 

rcqulrMSMfeslMt 
did Mot lUrtict- 



.^76 ioUl 



fro9r«ii costs. 
For^<^>l»s osrnin^s 



10% 



31 MkHltUM, /MW 

T4^1«t VIII,U* 



^(|^-HLt^}e-scllool 

MoqrsA 

(ttorus, trsmun, 
jM4 9ios«n, 1970) 



rrofrsM jpsrtici-*' 
psnts coofiisrsd 
viiU oUsible 
s|>pllcsnt$ wto 
1) MIS not s«^. 
Itctsd, 2) could 
tiot bo nd tieisd 



(04 osipsriMnui. 
1(4 coiv«risoo 



fticr«ss«d •srnin9S<- 
ln"S>ro9rw« outfiUt, 



froqrM costs 
l^orovoss csrnitifs 



of s«l#ctioii, or 
3) .did ttqt sImjw 
op " ^ 



lOy 10 y«srs Mtixt ot iu^iitt^qr^ 

* ^ *MaaieJ^(o o or ' 

o^i^iil to |>t(y|rs«i 
W9CS. toif^oitn ^ 
^irniiKis siihtfr' 
- • — — ;^r^a»«v»cUH(r;t»s^O*ic»i — 
i c(|tul to.p]^^r«i 



Job Corps l>ro9rMB partici- 840 sxpsriMsntsl Increased ssmiogi 

pants ctjoiartxi sil oo*psrison 
(CAiii, 1967) with apiilic4nts 

who Mcs s«lcctcl<3 

but did not, 

pariicipsts 



Pro9rM costs sxclUd- 

ir>9 trsnsfors 
^^K1^n% cyurnings 
Msinistrjctive cotfts. 



3i 

10% 



4f • 



lo s^o G5 A^justMMtr Mda for 
r«»Itgrot#ih of ^t^rii- 
o Jn<^Ai 3% fliiicouqt 

f«t<i Osed is ik)m|v4- 
leiit iu s Sx dU* 
count rAte with 24 
9rowth. Twf» «l>br- ' 
\** Miivn «MMSurv» of 

e^rnltPtM'^siim ufMtili- 

eJucstluiuil qsins 

frt» IHTO-jrAM* SCCOIpJ 

^ ' c<ja|Ures %isi|cs to 
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'i V. 



.jpf^^r^r/outcqi^ 'fhe. ou€co^^^ always, tKerisfb^ be 



.^studies, naOce, i^^ tl^e re?ui^^^^^^ 



.|ev,g,;.i,,;:r^aom;rasi^^^ would -hay^"s6#; c 

that.^tiier,m6asur were hot Siiet differences' 

• .in. ;ttai-vOutcpnie -measurement .metliodology . Wh^n comparisons are made ' between 
..pxoijiama howeve?,; one cannpt/s.eparate; the,; true 

'"^Iffe^^hpeiTin^^^^ to comparison group •bipes.- 

A ;second diff^re^^ the; sample. 



"S.. . . ^^£-26- '.(for 



rused.*6 ifea.sur4-:party,ciL^^ ,T*ie.j|arg,er. the' sample 

■a^ givfgh'fiop^lation,.. gria|er/the confide tliat ;c&n, be 

i»laced'' px' .the^ ;The':iamp,le, sizes ' ■ 



■programs, listed in Table- ptlt.2yrme,^i,mr^ 6^609. -but only two _ e 



.*ad:;s#i)ies,.pf :-^^^^^ Scliiller,,. 
,19,78) .- whnejj4eterau^ , '. r-V^'l 

specific evaluatioh* i^jfec€xl Ms r- tS^tudy With the .same, objectives But ; ; V:'|^g: 



KThis- eyaiuat^^^^ Su|p.6r5fced 'Work has, .a, cgmbine^^^^ . 
3>pb0i • since^the ^foUr. tir^et grpu#| %ve ieen .analyzed/ separate instead 
• •ofi'.poeied/tpsetii'e^^ sample,, sizes, 'for the . 



..k'" <d "■ \ - ■ ■> V. ' ^" - , ■ ...... ...... . . . . . ,„ 



saiiife ' ef f ectsvwHicH aiire' less •oreciae- than- thoise of studies wi f h i arooT- X-M 



f^i^9%H:y^9l^; ^re; 'iess::jprec£ie. studies with larger 

^ ' ' , . % ' li^^ 7'^^^"'?^^^ '9Pi9lf?4B^^\' ^9^oujE>':m^ .assu^re^s . that * Vi^^f 



^^l^a^ff'Ji?^^^ impictS; a unbiased^ the^ size of the sanpte 



fe*'^ ' ^^.:The; fkrger ^'tfie- sii^l#> llcj^er^^ l±e ^more :precise' "this "unbiased' estiinate . " ^ .''^| 

.i ' WiliV-i^^ ;a'. M>"^re^ qt ' . Gopd^ estitnates' ;'a; -prograun.U- '* ' r 
;«|^c^0^^e||^r^ and an adequate cpnparison groiip: . . , 

studies differ,, nor is it the dnl^ factor which ;makes the. compauri^ : \! 

o£ progrsuiss diffi^^^ The; acc6\mt^ costs ' V ' l 

*^at are. .chosen/ for measurement and; :the perspectives^ from, which,^ they are , ;| 

.yiewed^^a^^^ * - : * ^ . 1 1 



^cleai 'exception Is the "the Vera Institute of Juistice (Friedmsmr 1978); ^C^^^ 

[ . : . * - - ^ ' ' ' ' ' ^ ' ^ . ''^";! 

which :present^ rissuits> from the .per spe^ ^Other • . 'il 

situdies/used* a mixed pgrspebtiye.. Cain^, and Stromsdorfpr (1968) and ' 

\ ^ * ^ * ' , ' - - ' « * ' ' ' * J* 

Ste'omsdor^ (i'968) , for ihsta^ counted a reduction in transfer payments. ^ ' .:v^| 

as a tienef it-r- and,. Sbhiiler: (1978); treats program wagesf .and allowances ^ 

as^ a cost->^^ ev^^ fifrougli^. t^^^ of-ed.1 three analyses used a social 

^perspe^ctiye^^ * * / \ . y • . " : v ' - ^' f 

, - , ' : '•T^'This Ina^ ; , vvVI 



1 



^because .altJipugh trahsfeE reductions are bisnefits; to nonparticipants 

' , tliey rep^^ should hot appro^^ ' 

fv 4:1' ■ • .^0^^!^ C?^-^^^^ 4o? !the iSQciai perspectiye also, because 

If^l^l^i^iitJ^ ;c6st:s to non^articip^^ th^.V ar^ benefits, to par"-*^^ 



participants . . "ll 



twi tk^respiibt . ^tq dj^f f er ehce|, in which, ^benja f its arid costs: -are - 



. ihciudedf authors, .sometilnes disagree about, which: ^beiie fits, or costs are 

^smad enbugh to djgxipr.e ; ^rnqre ofte^ icertai^ bi^nef its ^a^ have not 

;bew raeastur.e^^^ the studies; Ijacked the resoiirqes or the 4ata^ to 

dp so* .Whatever; :the reasons,. ,the comparison problem is further aggravated. 

:by^-tiie.^diffe^ in behests arid, costs considM we WMted^ . 

coKpare .SiipEO .Work. wit^T Cain' s- (1967^ boirps study ,^ for; 

it 'Wpuldr.be. difficul^^^ to know how: to: treat those, benefits (e.g. § .reduced 

crinie) that Vre:^^^ for iSupported Work but. not for the Cain Jpb 

tCprp^ ,study.- Dropping tihe, addit Supported .Work behef it, xecaiculatihg 

" <net;.^present yal and cpmparing^ resiilts to that of Job Corps would 

hoty<necessari^^ giye a correct ranking^^ of the two prpgramis because the * 

:exciMed benefits might. be higher fpr one program than. the other. 

A"* simiar .prbbljBm ar^ to compare evaluations done 

. -'^from different perspedtiv^esrrfor example, Suppor ted Work and one of the 

/Vmixed perspective'* studies.:mehtipned earlier. If all the information 

;existed and were readily ayailable, the mixed perspective could be changed 
* * ' ' > . » ' ' 

to a social perspective by dropping put transfers. While this is conceptually 

easy to do, however r it is often pr.acitically in^ssible because transfers 

may not .be Identify isplated frpm program costs. 

Another aspect 'pf methodology that 5^ries across analyses is 

the procediiure uised-^^^ extrapolate benefits ..into the future. The discbunt 

. rates; :e#l6yed in t^e studies rahge^ ^f^^ 15 percent. Assumptions 

regarding the-^d^ benefits also vary. Some studies assume ^ time 

horizon of one year, ; others 10 yeairs, and still others the remaining work 

iife-of^pi^ or 65). Some assume that 

iv ERJC . : . ^ 357: 



;b«n«£iits iwjja^rf'in fiiii?; -force- tJii'slcnldrjB-t^^ Others assxin«' tha ' 



thex dacax at f at^s- ranging, ff rom^ 6; to. '35- 'percent per. yisar . * Differences: y^S^ 
In/extx^^ problem for a 

, «>mpMison^ sihcei siii^^^ riBsults using several different ^ . . 

aistM^ptipM if t^iey dp^ hew bSnef it-rcost results .can be calculatad ^ ' ^ 

, ib/, long/as. ^tt . - • 

\Mathod6l6^gical differiMices> then ^ are, o^ different .types, and ^ i>i 

• ^ ^ • ^ ' , ... . .-^ , . ^ . - ^ - ^^^^ 

' not all diffeMnc^^s :b4kr ekipia^ bn'^the cpmparabili of results^ actra- 
•poia'tlon-.a^^^ au:e>'easie?t: t6:\stamdardize> although the> data 

necMsaiY for such a/recalqul^^ not always published. Differences 

in. accpuiiting^^^^^ difficult to deal With; When » 

perspeqtives are mixed , it i$ often impossible to reconstruct eistimates 
from a consistent perspective because the necessary disaggregation of 

the component results is not Reported. * when different benefits and costs 

• . .- - . ^ * • • ' • 

— are--ineasured-^.-4diar^^s^ftan^c^ 

- ^ ' . , ' - 

overall results. ^Finally, differences in the comparison-group methodclogy / \ , / ; 



used are the hardest of all to deal with since there is no way. to standardize 
across sttldies, arid the effects of biases from inadeqpuate comparison groups or 
different statistical estimatiok technic^is are unknown* 

in spit3 of these problwas, the Supported Work results will .be 
conqpared in rbre' detail with four other studies--the WIN-11 evaluation, 
tixe 1978 Job Corps study, the study of LIFE, and the Vera institute 
Analysis of Wildcat. Although these studies vary* in their: degree of 
cpaqparability with Supported Work, they share certaih characteristics 
which make comparison efforts mora likely to be fruitful: they are all 
recant studies and they had target groups similar to those of Supported , 



i . 



:Geher2^^^ spe|Udhg>rt^^ measu^^^ benefits and 

♦cost's:,. . Two^^Qf them (LII^ .emd' wi^ used; random^ toyexperi- 

;^mi8ntai :arid ^cbnt^^ Corps)' made ah unusual 

.e|fort« to find: a. cpmpaucisOT^^ isimilar to t±e e?5>eriment2d,, groiip 

• :and to control' s^tisticaliy .for^ measured' 'differenc 



* ; • . . * ' . " 

The. Work, Incen established under . the Social 

,^ecuxity :Act in 1968> proyides;^ employinerit, training,^ and suppojrting . 
' services to welfare, recipients- WIN-.II (this is the WIN program as 

reformed .in 1972) supplies varying levels of service to recipients, 

^' *. ' * . 

with some receiving minimal services, some receiving placement help or 



training services, an^: others receiving partially or fully subsidized 
employment* . ' * , * * *. 

Schiller's (1978) evaluation of WIN-II differs from the Supported 
Work evaluation in two important respec;:s. , First, it relies on a 
comparison group rather than a randomly selected cbn€rol group to measure 
program effects. As noted above,, this inevitably ^creates some uncertainties 
about thd measurement of WIN*s effects. Second, the benefit-cost analysis 
uses a mixed-perspective accounting framework in including participant 
.wages and allowances (instead bf foregone earnings) in costs, and it 
does not include value of output of the subsidize employment cQH4>onents 
as a benefit. Because the pecessary disaggregations are not reported, 
comparisons With Supported Work's social costs are not possible > and 
comparison of overall net present value is clearly inappropria^te. Nonethe- 
less, a .limited pomparison with the WIN-II evaluation may be useful. 




important , comparison, is with; pbstrprcgraxh earnings 
-'j^tJ?: females by • . 
4 **9'4est-^^ Schiile^^^ reports results for five different . 

levels of swv^^^^ :np;;se3fyices^.J^^ educatibri,, training, 

and 'StdDsliatz^^^ TSie- components most siitdiar to Siapported^ 



;WorX.,are pJT:>^^ subsidized employment) and work 



experience (classifi^cR as 30b search) • The < annual net increases in 
- earnings for; femal^^a amd $231 for subsidized eny?ldyment :smd 

" fjob^^ea^^ Although differences in the length 'of 

followruE^/ Jcomparis^^ metihodologies, and estimation techniques— 




the Supported Work evaluatic^n that job-creation prbgrams appea^r to be 

able to raise ^he post-program earnings of female AFDC participants • 

• * • 
Earnings gains, ^f course, should not be judged without comparison 

to costis.' Unfortunately, , as noted above, the cost data reported by ^ - 

Schiller (1978) are federal WIN budget outlays, 'not social costs. These 

estimates cauinot be compared with Supported' Work's costs because they 

include participant wages and allowances instea^J of foregone eaxmings; they 

include the cost of child care and supportive services provided by WIN; 

they omit .central administrative, costs; ana they omit some project and 

overhead costs. •< * • . 



. ■^'^Unlike the estimates reported here for Supported Work, th^^^^ 
and other estimates reported for WINrll do not include fringe benefits. 

2/ * * 

I ^^Work is in progress at Ketron which makes use of a longer 
follow-up pe'riod amd different estimation techniques. 



k.E^ • ■. . ,413 



.. . Thf^ .Wildcat Sexvice^ as discussed in Chapter. 1, was the 

f if St Supt)or.t:ed Wbrk, prograa in the United States and the:, stmulus fdr the 
^national-Supported A bene£itrc6st:\e\^lua,ti the 

)?ildcat i^ogrMa cpyiciiig tte first three years a£ter eiurolliaent wa^? »ade 
by Vera (Friedman, 197^ 197? arid; 1975\>^ The progrM ii^ 

pants, iniiluded in the staidy wiare MWradd^^ though wlldcat;:iat«ai: exuroiled 

V " " \ ^ ' , .... ^ , ^ ^ ^ , 

exroff endef 3 .imdvia^ stillr- i^en it ! of the national; 

deTOristratiohr/yqiiths^.a^ recipierits. 

* ; '^-^ J ^ * . ' . ' ' 

' ' ' ' Vera's .(Friedman 1978) f indings are presented in Ta^le 

Alongside ithe results for 'tite ;natibnal de^ t^get 
grbup after- 36; mqntho;^ Vera (Pf iedman, 1978) limited its benefit-cost 
sualysi? to the nqrip«ti(iipaht 'perspe^ The neceissajry disaggregations 

wore reported,, however, so/ that Benefits and costs^frbm the participant 
. arid 'Social pMspectiYes.\<!!2m 'be^-:d^^ - - 

^ABoth^programs'show a^^^ net_ present social value, fpr 

•three :year.s. Whiie tlie o^erail Wildcat f ir4ihgs aie r,elativ^ly oore 



^^'Sheres([jlt&:a^^ Chapter 14. 

%A::sepeurate b^^^ tey Lee friedman (1977) 

-^s^ oh' preli^^ ^ 

^'^Results'^f6r.\t^^ are iiased oh '^easured 

differences.! for -the. f ir^|: 27 mbnt^^^^ entire ^sample aiid the bench- 

mirk patina te fpr ^^n^^^^ not ^ra^lj^l^l^^y?"^. 

i6 -TOni:hsv . .f.^'/' - , • 

^'^The nohparticipimt benefit-cost, findings are presented by Lucy 
: ^Pri%to«m. (1978)^ in fai^iei I4.1, 'i»i 114 earnings data are 



re|>oHM. in.-TablM _9i4>^^^ pp.- 65«67i. 

S^erIc • ' 



-A 



^ ' 'iik;i«.a«u<l^TA« i*ayi«utiLM,.t>y' I'Artlcl (Mints 

Huaik:«Ml CrlMiiiul Ju«Uc«i SyuUM Costs 

|(tMlucu4 Utuij/AlcolMil Tr««t«Miit COMtu « 
MtftSuLod thMi ot Alt«UMtiva'jBduCiitioii 4iMl 

t 



fpru«|t>n«« i:Ariitii«|M 
■llIjr'Mi«:wut""^lu5~(llOI«f tTlJ^Hliuitf-ODStaJ- 



tutic:ul ttMKJmttr^tloti 
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t. HCmsi tlui Wildc«L ru:miLtf ^rf tiMk fl<jur«is In rrlwOiuii (lt)78> lhfl4t«IJL»y/17.S |ittfcimt ithm W <W<l*tor> to rM<Uct t^rlc^S lu 

thu fourUi «|u<<rLttt ot WC, tiM mlddlw ^tMiriur ot ttm *Ui^ colloctloo |«riud for tlis lutloosl 2»44)(ioctttd;WurlL i j 
JciMiuttratlon. H^u lUtlbfisl SuiHiortud Work O^^istr^tlon riiiiuita Atn htMclm^tk. •^itlMtua tot ths 36 aoiiUm Aft«r enroUr 
■Mtnt to Mako Hhm cOM|j^r«bltt ah pus vlblti; with tito Wildcat ettiiML«s. IXtt^ll my not «m|u*1 toC4l diM to rounding. 



Hue aitfjiturod 



5 ^ . . 

. 11^ 1^1^ '''^V^'^** oi*%>riiiin4| cost is Um sua of project and ovarhssd jcbtts* 



A21" 



.fii^r«W:cr#f'^^ iii .mi«i«*dingft. ahd 'the -overail 



:s6m of :tii«'^'fii^^ benifit ^ cojbts foi^hents draws 

attention to som Icay dif f arancas ^betMan. Wlldciat and tha national/ 
damoMtration, as.wall as batwaan Var^^ (Friadman^ 1978) evaluation tech-> 
niquas and tbosa.,dascribad . « 

Firsts vhila Wildcatla .progran cp^^ par participant are slightly " 



highar than in tha -natjLohal dimohstxation, W costs par year of 

*sarvi.ca ar> ovar 40 pyrcarit iowafr-- ^avaral possible reasons for Wildcat's _ 

restively loWar "opariBiting costs can ba idanjbitied. (fiB of the cauisas 

^is that Wildcat had relatively fewer matarials^intensive construction 

an<i retail service work projects.*^. Another likely explanation of 
• , • t* • . ' • , ^ ' . 

' Wildcat^ s lower operating cost is lugger program scale* The Wildcat 

' pxfogram at the •tiioe. of Varans (Friedman, 1978) study had about three times as • ' 
'^^ISimynpiurtiTjip^ as-tfre averaaa^ita-JLn^he^atio nal demonstration, w^ich 



wptild be expected^ to r.esult in lower operating cost per participant*— ^ >4 



• 'Second, Wildcat's estimated value of .in**pi^pgram butput is much 
higher than the benchmark esuimata: for xxi% xiational demonstration. This 



'-^iiip average lengtii^piL-program stay by Wildcat participants was 
'75 weeks> cbnpafed toi 29 weeks iii the mational- demonstration ^ * (FriednanVx 
' \ 1978> i?; ll30 ' , " ^ % 

•> . • ^ * • >^ ' 

^ _ -^Qalj/^ p^ jflots listed in Appendix A to 

\Friedmanf^Ci978) cprre5q?^)nd;tp'co^^ projects other tnto painting; 

'\*^nbne aSre^^^i^^^^ 



; r^Scaia economjLes invSiipported Wor}c site operations ^au: 
' temper- an (fprtSicoming):. v ^ 



aura discussed 



^partly xefiects cUff trances. ^i^^ length of" stay* Even on a ^ 

year«:pfTservic6 basis., hbyever. Wildcat's value of inrprbgram output . 
($8,185)' is 36' percisnt higher <tom Sopported Work's ($6,018).^ Wildcat's 
higher estimated' value of^^output auLone ^e^peeds social costs so that 
benefit^cost i^esults are! positive without including emy additional 
benelfitSc ' One reason ifor, the hi'gher value/ of output ii that more 'of 
Wildcat participants' ehrollsient tiiae is spent worlcing on projects sxnce . 
Wildcat had less absence time and less program time in nohvork activities. 
Finally^ ^al though estimates of the value ol outgut for Wildcat and 
the. national, demonstration were generally quite 'close for similar types 
of work. Wildcat emphasized activities that turned out to have higher 
value of outp|^t (net of project cost) than those emphasized by Supported 
Work/ In addition, one. exception tq the generally simileu: value of output 
results was in an activit^-^building inaintenance--that was iit^rtant 
for both programs. The higher, ^stima^ed value of output for building , 
maintenance projects i\ the Vera (Friedman, 1978) study further increased • 
the Wildcat estimates r'<i?.ative to Supported Work. 

Third, while the post-program earnings gain 'of participants in 
the nationed demdnstration was estimated to be"small. Wildcat participants 
registered a siibst;antial gain. There is some evidence/ however, that the 
post-progr^ earnings of ex-addicts in the national demonstration may, 
havesimproved over time in relation to the eaurnings of controls suggesting, 
that post-progi^am earnings gains may continue beyond three years, y ^ 



Post-program earninga, gains for Wildcat, in contrast, decayed over the 
three-year period.— 



-r- 

1/ - ' 

-See Frie<3cian (1978), especially pp. 67-71, 78-88. 



Pourth, the differences: in; i^^ (due to Wildcat's 

*Y*»^ length pi ^s^y) and post-program earnings are reflected in 

':■ \- \ ' , " ' , . » ^ 

t;he~resa^tl3^for^ JL. 

- . . • 1/ 

Deaipite c<?rtain measurement differences^— both Vera's (Friedmem, 1978) 
' eval\iatibh^ and the present study estimated that approximately 12 percent of 
the^liotal esqperimerital^cpnteoi difference was paid in increased taxes. 



The greater reduction in transfer; paymehjis also mirrored the relative earnings 

^1 > ^ ' - ^ \- ' ^ . . - , . 

results, though the increase in unemployment compensation to participants 
in the riati^al demonstratibn--a transfer riot measured in Vera*s "^(Friedman, 
1978) eValuation~al50 was a factor ia. this 'difference. , ' 

Finally, the benefits of reduced criminal activity for • the 
nlitional demonstration are substantially greater than those for Wildcat. 
This is due to both observed behavioral differences and difference's 'in 
-the techniques used to value behavioral changes. While Wildcat initially 
had a greater , effect .on participants in reducing overall arrests than did 
the national demonstration, the effect .quickly decayed.^ Vera (Friedman, 
1978) ^valued the overall Wildcat arrest Veduction, measured by interyiew 
data, .^n).y in ;terms pf criminal justice system costs.-^^ As- described 

^ Vera estimated only S2d.es and, incc»tie taxes; the national dmon- 
stration evaluation also included social security taxes. ^ Sales \:ax payments . 
were iinpiited in ,a similar manner ih the two studies, while income tcixes were 
€istiinated somiswhat diff ernntly. New York State and City sales and income 
tax rates for vera (Friedman , 1978) were higher than in sites in the 
. national demonstration. 

* . 2A« 

^ The arrests rate was much lower for Wildcat experimentals than con- 
trol- during the first 12 months (.26 per participant year for experimentals, 
.58 fc: controls), about the same during the sec/»nd 12 months (.31^ .32), 
and higher during months 25-^6' (.40, 127).^ Friedidan (i978), p.. 80.' 

1 3/ Friedman (1978) , pp. 117^118. 
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in diapter III, arrest reducHons resulting from peirticipation in the 

** 

:xiatioii^d;/de^ al^p .mi^asured through interviews, were 

disaggregated by criminal charge and adjusted for respondent underreporting. 
The vaJ.ue attached to reductions, of arrests took into account personal 



injury, property damage, and stolen property as well as criminal justice 
^'and insurance system cos^s, * ' ^ . ^ 

The comparison thiis indicates that the^ primary difference in 
-yiigiii>g c-hamg ^^QjXLjiiMer ences in net cost (cos t less value of output)^ 
apparently caused by differences in scede, time spent on output-producing 
activities, and work project mix. Both programs reduced arrests and 
increased post-program earnings, although the effects decayed rapidly 
for Wildcat but not for the national demonstration. 



D, LIFE. 

LIFE (Living Insurcuice for Ex-Offenders) was a controlled 
experiment using random assignment conducted in Baltimore, Maryland, 
between 1972 and* 1974. , It provided fincincial assistance to a sample 
of males (randomly divided into experiroentail and control groups) who 
had been recently released from state prison and who had a high pro- 
bability of recidivating. The program wa§ designed to f&cilitate the 
io^ seaurch activities of these ex-inmates cind thereby ease their transi- 
tion.from prison into the labor market. Li:?E thqs differs from Supported 



1/ ' " 

A component of LIFE provided job placement services in addition 

to or as am alternative to financial aid. However, this component did 

not .appear to^have any measurable effect on participant outcomes* (Mallar 

and Thornton, 1978a). Therefore, evaluations of LIFE have focused on 

the financial aid component. 



Wqr%'in.:ti^ respects. tlEE did not , provide training or work 

" -i^ e3qE>erience> :30 that its. scope is .far more limited than that of 

: S^ported: Work, and ._its .target, ^oup . differed from Supported Work's 
ex*-offendel:si 



* An evaluation ^6f LIFE was conducted by. Medlar and Thornton 
(1978a'and 1978b) using procedures and assumptions similar to those 
used in the Supported Work .evaluation.^ ' 3;t estimated tlFE's social net 

present: value per participant to be between $400 and $4,000 rvdepending 

i,/ - ^ ^ . ' 

on what assumptiohs were made regaurdirig displacement, discount rates, 

1/ ^ " 

and decay rates. - The bulk of these benefits* derive from increased 

output, with siibstantiaU. reductions in burglary and larceny arrests 

also generating large benefits. . ' 

While the dat^ f rom Supported Work do not allow a benchmark 

net present value estimate to bt made for ex-offenders, a few coir?)arisons 

can be made between the results for the first year in LIFE and the^ 

results from Supported Work for months l-aTT^^^FxrsI:, the reduction in 

total forests was much larger for LIFE., The control-experimental 

difference in average number of bu -* ^ry arrests in on? year was 0.065 per 

participant for LIFE while the siml result for Supported Work during 

months 1-27 wrs -0.01^ burglary arre^i^ per participant per year, (i.e^V 

experimentals had more burglary 2u:rest > controls)* Given the estimated 



1/ ' , ■ ■ ■ ' 

The lower bound estimate assum^^ « '^ 'percent annual discount 
rate, a 14 percent annual decay rate for ean ^^s and welfare differentials, 
and that half of participant's earnings gaXm . fleeted the displacement 
of nonparticipcuits. The upper bound assumed \ percent discount rate, 
no decay of earnings on welfare dif f erentialv , ^ Ijto displacement. 



r«TOi»^e cost, per arrest of- ;bi^ $8,749, t^his ampli^^^ a - ' 

'.tsubstam for :LIPE*rrtot2^ burglary benefrts :pf $569. per 

eirSicip^ for LIFE iW one yeMr-con^ared to ah estimated net 
ahhiiaii , coiit >of $131 per participant for Supported Work ex-offenders. 

. . . . . ...... ......^^ . .■ ^ - 

A coi^parison of other control'-eacperimental di:^ferehces for these groups 



ot ex-bf fenders shows: (1) LIFE redticed larceny arid motor vehicle 
theft ^arrests while there was ^aui increase in these arrests for 
Suj^rted Wp (2) in bo^ prograi^ there ^were estimated increases 
-in-rbbijery-ajaresT^T-but-th^ 



for the first year after enrollment in LIFE appear to outweigh those 

for the first .27 months Q;f Supported Work* 

On the cost side, the' two progratms also drffer substsmtially. 

LIFE wais a simple transfer program providing weekly cash payments for 

up to 13 weeks. As a result, estimate^ social costs were quite small, 

2/ 

$12S per participant—. In comparison, the work project orientatxon of 
Supported Work led to greater costs, even when the v^lue of output 



^,3 



iiidrease ob served for Suppq rted^jWork; Q^the post-program earnings ^ ~% 

gain for LIFE was laurger than that for Supported Work; and (4) changes . ^ 

in the use of transfer programs were similar. Thus, the. benefits 



1/ ' , 

The LIFE evaluation was not able to estimate chamges in all the 

transfer programs considered in the Supported Woxfk evaluation.. Also, it did 

not estimate the value of chauiges in use of alternative en5>loyment amd / 

training programs or drug treatment programs. If these items were euided 

to the LIFE evaluation, the results would not chemge substantially, since 

the change in alternative program use was quite small and the LIFE experi^, 

mentals amd controls were screened to eliminate persons with histories of 

drug or alcohol abuse; ^ 

^^Adad!nlstrative cost data were not avail2ible, costs were estimated 
on the basis of administrative costs incurred in public tramsfer programs • 

■ " . - • 427 
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tv>\' 1"' " ^- * ' / . ' . '" - -3^;'-^* *'\'»C'' ^^'^y^ " " ..... w,-.. 

'f9t '^M^t "^K^^ sociaiiae;^^^^^ olT LIFE ;af,ter 6ne year .was 

*|o.sit'i^^^ whije -J^ first 27 



raontftsVo^^^^ piurticiEants , however, were 

^t^ter^^^ fin"^ci^^ iA\Supj^^^ transfers ijn^^ 

; Supported Work wages^^ceede^^^^ earh.in^s. and prqgr% payinent- . 

ga:ir« adi^£ewd\by ilFEjpariiq^^^ Beyond^ this early, period, coaparison 



Of the programs is dif f icui€ 'be the uncertainty over the benefits^ 



after month 27 for ex^of fenders :xh: Supported Work.* 

^ ^ . c J _^ - , , , 

'Interpretation of results is also' made difficult by the differences 
between the types of ex-pfd^ders enrolled in the two programs—particularly 
LIFERS emphasis on repeat theft offenders with high a priori probabilities 
of fefcidivatingf. Because of this orientation it is not clear that LIFE's- 
positij/e tesults would persist if the program were a{>plied, to a broader 
ex'-of fender population like tha?ti enrolled in Supported Work. Further 
evidence on this point comes from the evaluation of the .Transitional Aid' 
Research "Prpject^ (TARP) I Rossis .Beck /^Le^ri^^ forthcoming), a program 
t^t didJ^^^ some .of *tJie LI^^ features to a general, population 

of peoE>ie released fr6m:state prisons in Georgia and Texas. An evalua- 

- - ;^ f > ' ' \ . / ' 

tion of TA^|P 'indicated no significam differences in criminality or , 
eimi'iigs between experimiaihtais auid controls^-- • ^ / 

/ ' , ' ' V V ' •> • 

It' can be pohclu^ed- that LIFE did accomplish two of Supported 
W6rk*s major goals--reducing, criininai activity and increasing post-program 
earnings—at far less cost**^ It does noii necessarily follow,. however'^ 



that ^policymak should; flavor it oyix Suppo rted Vtork. for a generaUL: 
-pdpxda^^ Increases in .future be^ef^ for supported. 

Wprk;.;or for jSupported^ Wor k^s croals~no tably the transfer 



of 1 :irico^ through >i^ages; ipaid lor w6rkrr-*c6iiid Biake Supi>orted^ more 



Job :^or]^s» is 'a federsi tea^ihg jpfqgran- for disadv?mliaged. 



.Youths that :was,;est^lished-^i^ is how; 6jperated''by the VJ.S. 

Department of \La^ under Title iv of the- Ccr^rehensiw Btapipyron^ and 
Tri^ning^-;^^^ (CETA) . it differs, from Supported Work;,in at least ^ 
three.iri^r^t^ respects. First, it is largely a residential prograun. . 
Second, parid-cipants .speiid most of their time /in classroom education 
and rather thaui in work activities.^ Third, vAile Job Corps 

provides a. cash allwM^^ to participants as well as support services^" 
it does hot pay them wages. * ' - . 

Results of an eyaluatipn based on the first .six months .of post- 
:prpgram. observation of Job Corps by Thornton, Long, and^Mallar (1978). axe 
presented Table;. V.A: alph^ with the Sfesults. of the evaluation for 
Supported Work's youth target group. Overall, tiie findings fox: .Job Corps 
arc; decidedly more favorable from the nonpar tic ipant and social perspecr 
tive.s than those for Supported Work. Job Corps participants produce 
' substimtially rtbr^^ and show, a far greater .reduction 

-in. briminai activity.' -Miese major differences—along with relatively 
greater reductions in, drug treatment, costs, the \x^e of alternative services,. 
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CoaU (doXlars) 

rro9ia'«'0iMratln9 Costs^» 
/ Xn-Pro^raa earnings _ ' 
fora^ona Earnings 
\C«ntraX Adiiinlstratlva' Costs * 

^ • 

S ilat Prasant Valua (ianahta Minus Costs) 

r :^ \ : r- 

lOTKt TbaOob Corpa raauXts ara tha benchmark figurss In TK>rnton, tong, and Mallar (X978). Tha national lupportad Work 
daaonstration rasuXts ara b«nc!iiMiirk: f seiMtas* OaUiX^ »ay, not aquaX total dus to rounding. 

- • ^ \ : - X :^ ■'. ■ , 

^Som aob fcorps work proJaoU^ auch as on-csntar doraltory iaproyaMnts,^diraotXy banafit ^rp w sa h a r s^ 
' ^ \' ' » ' y ^ ^ ^ ' * 

fe/vjrogra» pparating cost la tha suk of pfojact and dvarhaad cost, for Job Corps, thia also includas unbwdgatad progra. 
;^.coBU astiiiatad by Thorntf^ 41 

S/itiii iiK;Xudss obrpaMi«>ar «1X0MIAC^ pXu«.tha astiMtad valua oje in-kind transfars to Job Corps trainaaa in tha for« 
/or roo«, board; and' aia^ 0»rp«MwUrs d^ 

O lob.'corps astlBiatis be foragona:aarnings taka .iiito acooiiuAt "foragoha** tajt payvants whils in Job Corps* >ost-progra« 

;ap|^Qlij :tax payiohtg^^a^^^^ ' 



V 



and training allowancirn^aiccount: ^^fo^^ ovarall differances, it also 
can be npt'ad that, in thia^ cu^r Supportad Work constitutes the smaller 
pfMbhettwo socia^^^^ ttia net cost of Supported Work (program 

costs \minur ^^^^ inrprograuBi: out^ is lesif than the net coist of 



Job^torps. ' * ^ \ 

Despite the;ir higher j^^^ corpsMinbers do 

not come but as well from t)^ participwt perspective as participamts 
invSup^^ This is duf to the fact that higher Supported 

Work^in«?prbgram earnings dominati^ the participant pesrspective caicula«- 
tion. ' ... « - , , 

^^y^o^ ^i^f^^^'^c^s, for- particular 'benefit and cost components 
mirror sj^cific program differences. First, the difference in the value 



of ^in-program output resiilts edmost entirely from theyfact thiat Job Corps 
participants spend most of their time in the classroom.^^ Second, 
supported worker wages. and\fringe ber^fits exceed the cash allowances 



and in-kind benefits provided to corpsmembers. by design. ^Third, while ' 
the operating costs of the "^n^o^ programs are similar, a substantial part 
of the Job Corps expenditures Is devoted to residential services and 
classroom staff, while a larger «part of Supported Work's b\idget is devote4> ' 
to inputs for work .projects. "Fotirth, there is a highly positive benefit 
^rom reduced corpsmember crixoinal activity, while chere is a slightly 
negative benefit for Supported vfork associated with criminal behavior on T 



• 1/ ' ^ - ' ■ 

— On average, corpsmembers spend only 27 percent of th^ir program 

days ' assignied to worH activities;^ see liiornton. Long, and Mallar (1978), 

p. 35.. By (Domparisbn, 82 percent of Supported Work hours are spent on - 

work projects'; see .Kemper amd* Long (forthcoming). * ^ - 

r ^ ^ ^ r 372. 4 31 



:thm :*p9^t^ of youth. Tht Job' Corpi effict on >'urticlpant crijMSi which 
VM Mi^tcially. sv^stutiail during tht inrprogran ptr^odf is probably 
dUa/in :pArt. to that pr5i^am*s; structured, rssidshtdal character, which 
takas youths who anrollad. oiit^ of: thair hoiRtt anvironmant*^ 

Finaliy# it should ba notad that, whlla thasa two ayaluatipns 
ara iMthodoIogically Ii8dlar> thara wara. ti^aa notabla ^analytical dif** 
farancas. Fir8t,j tha $upport:ad Work .avaluation had an axparimantal 
dasign#"whila tha Job Corps stu(£y usad a carafully chosan^conparison / 

* .grbup of: youths,* Second,^ tha Supported Work avaluation adjusted for 
' respondent underreporting of arrests; since this was hot done in the 

• Job Corps study, the effjact of Job Corps on criminal behavior is probably 
ttnder stated. "Third*^ the Job. Corps result at are based on only one year of 

. putcocia measureMAt, and 'tfhe benefit-^cdst results are sensitive to the 
. assumptions made in extrapolating the post**program '^dings« An updated! 
^analysis based on additional follow**up of corpi^mernbers . is scheduled 
for ptiblicatipn later this year. 

F. QONCLOSION* . » . . ^ . * 

Ihe overview of benefit<»cost anai^es presented at the outset of 

V 

this chapter enumerated the methodological inconsistencies that hamper" • 
coirparisohs like the ones attempted in this ctUtpter. The most ^important ^ . , 
, lesson from this overview is that comparison of "bottom line" results— 
that is, looking only at net present va\ue estimates for various programs— 
can be highly misleading. The specific 'program comparisons made later in 



i/see Thornton, Long, and Mallar (1978)., pp. 14-15. 
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the' chapter were cpnseguentiy; UmtW^ .to .relativ^ely similar evaluations 
•of pro.grains; serving- sin^^ jxoixps, and were focused on findings . 

: ' ' ''^} ' / " ' ^ • ' ^' ' ^ - ■ \ ' 

for individual^berie ahcl cost components rather than overall results. 

At the same time > cocpparisons of ^ b^^ results .that * go 

beyond tihe bottom linerahd' .ex^^ component b^ef its and. co^ 

can pirbyjkde ji very\gp64. pict^ Pt tke reiative 'merits ' ajid driw 
of programs/ the differences* in levels and typ^s of social invest- 
ments involved, of the amounts, of income' redi sir ibut;ion Mspciated with. 
•:he progr?iK3> and of which pt-ograin Effects and 'costs are L^nportant. 

For example. Job Corps' effect on participant crime is central to 'the 

\ ' ' * • 

last of the ,f6^v• Jomparjisons" presehted. Highlighting ^at one' benefit- 
discussing its n^^^^-i^/^ement, csmpauring it to SupportedS^rk*s effect on 
criminal behavior, and identifying t,^e role of program differences in 
determining the results-ogives a valuable insight that would be lost in 
a quick recital of overall results. ' 

Arthouch/ important to arriving at policy judomeats about the 
effectiveness of alternative programs, the stat.^^ of much benefijt-cost 
research. is such that these useful coin)onent-by-CvrAponent comparisons 
cannot be made. Questions about the credibility o$ Gi^>£.sured outcomes 
because of the comparison*-group methodoloc^y^ differences in program 
accounting systems and cost definitions* and poor docuinentatxon of 
methodology and results often make .conqparison. of specific components 
impossible* Even in those four cases where the progrsun target groups ' 
and evaluation methodologies were relatively similar, we encountered 
difficulties in comparing the results' once we began to <^^lve more deeply. 



. The: quality of behefitrcqsit/.evai generally, thus> needs 

. to-^bf : iaproved; if more useful compariMns: are to be. made. The evaluations. 

muft.t also be. extended to .a .wider range, of emplgyihent and training programs • 

The four studies included in the ^^compari^sprfs here evaluated- only a 

fractipiirof the employ^^ for the target .groups 

served by Sup|<>rt|Bd. Vto^ This.|is especially true for the ex-offender 

and youth/ target groups. Thg .p^iJDMu^_ai program f or- the AFCk: 

target group is WIN,^ though^ there are^other options such as the Work 

Equity Program (WEP) demonstration • There are -few employment and 

traiidoig options for ex-addicts, though several, drug treatment programs 

;hav« training and placement components. There* are, however, numerous 

alternative program approaches for ex-offenders and youth ^ ^ddi^tion ^ 

to LITE and Job Cor ^s*.* Those for ex-offenders include prisqn training 

and prison work progrAias; work rejease, post-release training, and" . 

/ * 
placement services a;id dnc6i»^ support; and othex: work-experience programs 

* * 

for^ex-of fenders. Youth eihplo'ynwsnt and training approaches, in addition 



to Job Corps, include a great \^iany work experience and summer jobs programs 

.1 . . / * ♦ * 

under CETAi I * ^ - 7^ 

pe«i?ite the limited number of comparisons made and the difficulties 
encountered, sthe four specific' comparisons 'we'' did make provide useful in- 
sights. . flJLthough some; qualifications, noted above," must be attached/tJo 

• \ \ : ' ' J ^ _ . ^ r ^ • r ' 

the evaluation, the compjurison to WIN- II: reinforces the conclusion drawn, 

from Supported Work, that job programs can substantially raisia pcfstr-^program 

earnings of female AFDC recipients. ^ The evaluations are too^ different, 

hdwever, to determine whether one program is* more effective in any overall 



a«hs(8 ;than t*i«;oth«r. 



\ con^rison to Wildcatv although it shows somewhat 'different \ 

^ \ / --^ ^ y r y ^ 

"*>Pt6gram efffifpts;^ these two appiications of the Supported Worirfcohcept''r 

<^d^^ind cqmpM^^^^^ This suggests tlutj^Support^ 

- ^rlc ii ^ effective eng loyaentr aiid t^^^ for ex-addfcts. 



;^e/.LilTB, results suggest that UPE may be a socially efficffent 
policy option for a sipitcii]^^ cpconp of ex-of fenders , but *it . Is; cb^fclea^ 
that, it would wojrJc it extei>dl(B^^ Supported? Work: target group; bwlVea, 
ttere ds; evidence that-otter-prdgrams s LIFE, but-^for-r-* — 



broaiier targer _gr.ou^ have hot achieved its* level of suceess.i^ and other 1^^ 
employment and training programs for ex-offenders have had mixed results 



atbeit,^" ^ , • • , . - ' ' - J. 



Finally, Job Corpsr-to which the Supported Work results for 



j^utn are compeured — represents an unusual policy approach junong employment 

.3/ 4'" 



and training prograins."" its largest benefit— reduced crime — appeau:s\^o 
be partly duetto its residential nature , which is^not typical of employ- 'V- * 'r| 
ment and training programs. If the reuults of this preliminary 'evaluation 
of Job Corps eure confirianed when th.e longer follow-up data are avaiiabl|g;|?i 
it will then appear as eu\ efficient alternative to Supported Work. As.' 
. ^ noted above, however. Job -Corps is not representative of programs for youth*/'^ 
aiia the aarrovniess of this c'onparison should thus be kept in mxlw.''* ' 

' 1/ • ' ' ■ 'J 

— See the Employment and Training Report of the President^ H979^i[;7 , 
pp. 199-200; Stephens an d Sand ers (1978),. and Smith, Martinez emd Harrison 
■^'(1978) for discussion of the Transitional Aid Research Project (TAp5>) . 

- 2/ 2 ^ " " ^iWh ' ' 

, . -^See Martinson (1975^ for a review of the literatureAj^ '.X 

*. *3/ / u — ^ 

: — Studies of other programs serving youths have mix?^0^dings . See^ 
for example, Bonis,. Brennan, and 'to^^ 
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OBMTER VI 
CONCIJaSZONS. ' 



1^ 



^ 1?*^^ presented -toe resi^^ an asse^ranent of the ^ 

'benefits ind costs pf lAe national Supported Work d«aonstration* The pur- 



pos^ of tois concluding .chapter is to trace, some of^the^iapllcationa? of 
' toe^ results fc^ a?d training policy-^ for future evaduation 

research; , ' . ^ ' 



lf~POEICTriMPtICATIONS- 



^^l.,two^.sets of policy conclusions can be drawn from the benef it^ost 



evaluation of Supported Wbrk. Overall jiidgmdnts about the effectiveness^ 

^ ' ' ' ' ^ t • ' ' . 

of ^Supported Vtork for each of the four target groups obviously represent- 
one important group of conclusions. Also important, however r are policy 
conclusions regarding individual benefit and cost components of the 
^- ♦ analysis that ajfe key to the overall results. 



1. ' Program Effectiveness , ' , 

^ / .The results -of the evaluation clearly iijdicate that Suppott€ki Work 

ha? been effective^rf rem the perspective of society as a vrtiole and the 

nohparticipants who i>ear, lAe taxes required to fund the program—in pro- 

?' . * : ' . ' ^ ^ ^ > ' . ' . ^ ^ ' . ^' y ^ 

K vidihg\ser#ices to APEC reca^iehts and ^-addicts* ';:T^e ov^all results * 

' are ^sitive. for tAieise two target grpvips, aixl. only, a ,drastic\altering of 

the behchmark assumptions would change the overall conclusjlons« 

* ^ The comparison of these results to those of similar programs serving 

sdailar target grdiips reinfpr^ 'pfelimin^u^'resvilibs of 



an evaluation of wni (the; primary policy option fbr^AFDC recipient^) sup-= 



portS'^the c-jhclusidn' that subsidized employment can be an effective policy 



..^^^ . .^.^ ...... 

- - .. ..^ • ■ • ; :■ . ■ ■ - ■ 

* « - • • , * * 

V • , , » r , 

for iiicreasing the mplbj^iiity of AFDp-.recipients* An evaluation of 



WUdcatV ;an' earlier application of the Supported Work concept in the U.S. 

and .the' only coinEairibl^ ^o^am^ fox this target group, presents additional 
\ ^ • . . ^ ..... ^ ' * 

eWdence) that Supported. Wotk is an effective approach to the employneht and" 



^ s ^ - 1/ 

-crime^problems^6f^exrad4icts^ri_ 



The, evaluation rdsultsr foi: the youth target groupr however, 'are ^ 

uftaiabiguousl^^^ While participants axe made better off by Sup^rted 

, ' * J^, ' ^ ' • • ' * 

\wc)rk/ the a^esults 'froa society and^ribnparticipant perspfectives 'are strongly 

: . » \ . ^ . . * ' * 

- negative—even under, reasonable alternative assumptions. It is especially 

notable that Virtually no benefit^ were^observed for youth?. in the post-program 

period. These findings 'are in contrast 'to the. available e/idence for 

.Job Corp'si^ a comparable program for a youtih target group, which found 
substantial reductions in crime, especially while enf oiled in chis 
residential program,"' and suggestive evidence iri tl^ »ininediat^. postrprogram 
period of an increase in post-program earnings. ' . ' 

' . Finally, the results ^from the evaluation of ex-offenders are un- . ^' ' 

clear. * The resultiS for the first 27 months after enrollment' are plainly 

jiegatiye— the least favoreible among all four target groups. However, there ' •-•^ 
*. - "i • . ' * 

is some levidence— based on a very small sample—of a reduction in aurrejSts 

(7 ' ' . ■ ' ' . / ' ,^ . 

and an increase in; earnings during months 28-36, m2Jcing it^exturwhely diffic;at • v^^,^'^V' 

to estimate future benefits. These future tienefits, under some assumptions.. ' ^ i 4 

raise tptal. benefits above* costs, f row the 'standpoint^ of society amd 




• , la; ■ ■ • . ' \ ;^C^^, 

. .."""The findings in th'e two. evaluations did differ for indilvidual " . 
^ bwefit and qost COTpohen^ Fort example. Wildcat's -cost was lower ebid esti- 
^ j mat^ value *ol higher (altKough this comparison should be 

inad^ cautiously gly that separate yalu6 of output eslfimates^were not lAade 
for Suj^jported WorkJ; The overall results, howev^, wore highly favorable 
7 ;iri'^b6th.!cases; . - ' . - . 

I ERIC : . • . ' ' 
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AonparticApants;^\mder* otOier assiroptionsr however^ they do not* ^'Jhile we 
danhot say what future h^^nefits will be^ we can say that they would have 
to be very large for the overall ex-offender results to be* as positive as 
;for the AFDC and ex-addict groups, ..^ ^ 

These conclusions^ as noted ^ are based on an evaluation of Supported 
,^Work from the perspectives of society as a , whole and of n^nparticipants, 
who pay the bulk of the taxes required to finance social programs,. -An 
assessment of the benefits and costs from the perspective of participants 
is also, important; especially because Supported Wbrk has intended distri- 
butional effects. The analysis showed that the demonstration has redis- 
tributed income to all groups except AFDC recipients, whose loss of 
welfare when they work is quite large. For this group', Supported Work v/ages 
and the increased^post-program earnings— Isoth of which are taxed—replaced 
^ a, much more substamtial amoiant of income from AFDC, Medicaid, food stamps, 

an(J other public transfer programs than was^the case for the othef 

* * t* 

target groups. 

f For all groups except ex-offenders, the results from all per- 

spectives are remarkably insensitive to changes in the underlying assump- 
tions.. For the AFDC, ek-addict^ and youth target groups, the qualitative 
conclusions are altered only when extreme, and we believe unrealistic, 
'assumptions are made regarding benefits and costs. For ex-offenders, as 
we have noted, uncertainty about sensitivity of the magnitude of future 
behef its , * and indeed whether they exist at all, to assumptions with 
^spect to, extrapolation makes it, impossible .^^o draw any firm conclusion. 
Tliere are inevitably, as with all evaluations, fiirther retinements that 
couid be made in the methodology. First, regression models controlling 
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for individual differences and incorporating corrections for interview 
^ nonresponse. could be used to obtain mpre precise estimates of program 
effects. AlthougK such refinements would undoubtedly affect the magnitude 
of estimates r Jiowever, they would almost certainly not affect the overall 
conclusions,^^ A second potentially important metbdological refinement 
would .be a more complete modelling, of the decay of post-program benefits 
over time and the causes, of differences among cohorts. Such models might 

make possible preciise estimates of future benefits in general and might 

* ♦ - 

also help reduce sbme**at the uncertainty surroundin<g future ex-offender 
Qrime benefits auid future welfare reductioa*: for AFDC recipients- Finally, 
analysis of the -statistical significance of the' benefit-cost results, 
similar to that done for ex-offender crime benefits, would be helpful n 
in identifying areas of particular uncertainty. While' all t3iese refine- 
ments would be of research interes'*, and would enhance understanding of 
the results r again they would probably not change the overall cpialit^tive 
conclusions drawn from the emalysis* ^ 

2. Kay Benefits and Costs 

Four ;ypes of benefits and costs are especially important 'to the 

overall findings. The first of these is increased post-program earnings. 

Increased post-progifam eaumiiigs are a key objective of Supported Wbrk and ' 

2/ 

other employment and training programs.— In addition, the nonpaurticipant 
benefits of reduced ,transferfe and increased taxes are a fiinction of income 

Estimates based on such procedures are \ptesented in the outcome 
reports and do not differ substantially from the experimental-control mean 
differences used in this emalysis. 

y ' 

Increased earnings also are the one benefit consistently measured 
in employment and training program evaluations, and thus aura an important 
elaaent in program ^valuations • 
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andr hencer-are closely associated with. earnings gains* The benchmark 

estiinates of post-program earnings* differences varied dramatically across 

the four target groups in Supported Work. Increased post-program earnings — ' 

and consequently reduced transfers and increased taxes-- dominated the 

benchmark results for the APDC target group- KoweVter,. post-program earnings, 

* - 

differences ^turned out to be less important for ex-addicts, uncertain for 
ex-offenders, and negligible for youth* Given the important role of 
pQStf.prdgram eeurnings. in determining overall results and the \incertainty 

I'm 

about earnings differences beyond the period of measurement, ic vrould be 

1/ 

desirable to continue to monitor the earnings of the evaluation sample.— 
' ' Another key benefit is reduced criminal activity. Reduced crime 



was the most importamt benefit for ex-addicts --so important in fact that 
the overall results are negative if the reduced crime benefit is excluded, 
but decidedly positive if crime benefits (nearly $4,200 per participant) 
are included. The results for youths, *in contrast, show no evidence of a 
reduction in criminal activity, and the _evidence for ex-offenders is 
ambiguous. Nonetheless, the crime reduction for ex-addicts, as well as 
the evidence for Wildcat and Job Corps, ^*jidicat:e that reduction in crime — 
because it is so costly to society—can be an important behef it of social 
programs, and suggest that tanplqyment and training programs may in some 
cases be able to reduce the criminal, behavior of their participants. 

Project cost—the costs of supervision, materials, equipment, etc. 
directly associated with operating the work pro3ects on which participants 
gain work experience— and the Value of project output, which are closely 
- related to "each other, also represent important components of the evaluation. 
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—^Some further follow -up of the AFDC target gtoup is currently 
planned, and all groups could be followed using social security records. 
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Project costs are the second largest canponent of costs, and project ouitput 
is consistently one of the largest social benefits -for all "foiir target 
groups-^-only the benefits of post-program output of AFDC recipients .and 
reduced criainal activity for ex-addicts overtake in-program output when 
estlinated future benefits are added in* The substantial variatioa in how 
well pordjects were ablp to produce output of relatively high vaaue {net 
oi project cor.t) suggests that there may be potential for improving 
the perfonnance of the program by modifying work project selection and 
operation. ^ ^ ' ' 

' i 

Finally, overhead cost—the cost of enrolling paorticipants, creating 
jobs, providing supportive services, placing participants in ^post-program 
j<As, and managing the program— represents the largest ccanponent of costs 
in the analysis. Finding ways of reducing it, without reducing program 
effectiveness in achieving its benefits, should be on the Supported Wbrk 
policy agenda. 

B. IMPLICATIONS FOR EVALUATION RESEARCH 

This 2malysis has implications not only for the effectiveness of 
Supported Work as an employment auid training policy, but^also for various 
aspects of evaluation research. Among the many things that could- be said 
about designing and carrying out benefit-cost analyses of -social programs, , 
the following sean to us to be especially important. 

First, very careful consideration must be given to the fundamental 

issues in measuring program outcomes: the comparison g^roup methdology, 

sampla.size, and length of follow-up. '^The concern here is not merely 

with the quality of evaluation research in general, about which all 

« 

analysts must be genuinely concerned. As^ described in Chapter VIII, 



coig^isoh o^ .^valiiatioh re^^ when the evaluations 

.dive^e from the » ideals of double b£in^ random assignment to experimental 
and conttol groups, . adequate^ samjple /sizer and' sufficient 'follow-up. 
Obviously r xnany factors- must be wjsxghed in designing prq^am evaluations # 
including theii: costSr but the importemce. of the quality of . the measurement 
of outcoiaes e^m hardly be over stated. 

Second r a well-thought-out, consistent ^«ay>unting framework is 
also invaluia>Ieoto^,benef it-cost evaluations r especially those of complex 
social programs with multipfe objectives. Su^y/ framework 'should include 
not only the benefit aind cost components > but adso their, impact from 
different perspectives. This allows users of the research to identify 
not only the laurge niamber of individual benefits, amd costs but also the^ 
distributional effects of the program. . Equad^ly important,, it permits 
them to weigh the relative importamce of various program and evaluation 
issues, and to assess interrelated program effects such as those of income, 
taxes, amd public transfers. This applies not simply to the presentation 
of f iSaingsT'butr to the-conduct-of-the-evaliiation-^^^ 

Third, adequate attention from evaluators must be given to f 

program costs. Frequently, e^enditure^ data are received from program 

operators and used in an evaluation with much less thought than goes into 

anauLyzing program outcomes (i.e.; potential benefits). As a result, 
♦ 

"cost" can mean many things. It can meam the gross cost of the program, 
net cost' (beiiause certain expenses or the value of certain program outputs 
are excluded), "taxpayer" cost, ongoing costs, accrued cost or obligated - 
cost. It is often limited ta direct costs—that is, excluding iinbudgeted 
costs, overhead, and- ancillary costs-- and sometimes refers only to admini- 
strative costs. There is an urgent need to standardize ^^ogram cost concepts 
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— what cpst^s should jprqptely b^ measiired- from a given economic 
P^^^fi^ct^^^ participahtsr. nonpfirticipants., or any other that may 

be important for a givferi evaliiation- purposed 

Fourth, it is Important that social program evaluations . go beyond 
traditional outcome measures: changes in post-program eaarnings and 
transfer program use. For exanqple, the results for Supported Vfork 

' ■ \.. •.. ■ • ■■ - • "-^ : ■ ■ 

^ex-addicts indicate the need to include the value .of criine related benefits, 
Because of the high cost of crime, even small" changes in criminal activity 
can generate benefi1:s that may outweigh those, from increased earnings .^'^ 
The Supported Work results also show the importance of valuing in-prpgram 
output. Net program costs woiild have been badly 6ver stated if sucK an 
effort had not been made. In this evaluation these (and the other benefits 
and costs) have been valued on the basis^ of the market prices or resources 
used or savfed and the outputs produced as* a result of the demonstration. 
The limitations of this approach,. particular ly^ts failure to estimate 
social willingness to pay, are obvious, and refinements or superior alter- 
native approaches would be valuable contributions to policy analysis, \ but 
the approach used here does allow -these important beiigtf its and costs to be 
valued and included directly in the benef^Lt^cost calculations along with 
increased earnings. ' • , 

Fifth, no matter how good the research design or the sample, 
evaluation results like the ones in tjiis report are sensitive to assump- 
tions made in extrapolating benefits and costs Into the future. The pro- 
blem is' unavoidable because evaluation follow-up must be ended, at some 



y 

_ -^^JL^^^^tion of only^'0.02 robbery arrests per participant per year 
would create benefits worth over $260 ayear (0.02 arrests x $13,135/arrest) . 
This value is of the same order of magnitude as the annual post-program, 
^arnings gains estiinated for ex-addicts. Corresponding reductions in other 
€ypes of crime would make total crime benefits greater than those for post- 
program earnings* 



.^iiil: jmd soon as possibld* hay« 

: tried to inaki^ reajwnai^ assti&^tibns in jiiak:Uig, the &nchDaMk exte^ 

auid -we have tested tdie sensitiyit^ of -the ri^sults to the assiaaptidns. 
The^-actr'ttiat''the re^^ were foixnd to be so sensitive 

• . that we do ; i»/^tiiiiJ^^ to make a benchmark estiioat.'^ underscores 

, the need for lohg-term folloWr^aM^ on a sample of substahtiaV siii* It 
also denionstrates the need for careful research on the methodology for ^ . 
estimating decay rates not only for earnings but for other, effects as well. 

The job of eaitiinating the benefits and costs of the national demon- 
stration is now finished, but the task of assessing Supported Wdrk 
is not over. The accounting, the computations, and the dollar values 
reported in this Analysis should not convey precision and f iiiality— -we 
certainly do not intend them to. The analysis is intended rather as a 
tool po be used,, among others, in making judgments about the dc^^irability 

* - K 

6f Suppoxrted Wdrk.- The purpose of benefit-cost analysis of social 
•programs should not be to arrive mechanically at an estimate of net present 
value that dictates an investment decision. Rather, the function is to 
identify what issues and program effects are important to consider and to 
weigh the relative iaportahce of these effects. Thus, for example, identi- 
fying what assumptions are most critical to the results may well provide 
more insight to a policymaker than assigning a value to a given benefit or 
cost. Readers who wish to make full use of the analysis, therefore, should 
recognize the sensitivity of the results to key assumptions, the relative 
roles of various benefit and cost components, and the potential importance 
of unmeasured ^effects and implementation difficulties. 
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